Rich.table and knowing the height of a row when rendering a cell

I’d like to render a table that has something similar to a git log --graph graph in one of the columns (see git-graph image for example).

The problem is that my table rows can be higher than one line, so the cell that draws the part of the graph has to know the height (to pad the cell vertically with lines).

My understanding is that it’s not possible to do with rich.table, as when the cell in the left part of the table is rendered, the height of other cells is not yet known.

So, it seems that the best I can do is not to use rich.table, and instead render a grid manually.

Is that correct?