This paper presents a comparison between the in situ and real time observation of a directional solidification experiment carried out at the European Synchrotron Radiation Facility and a direct simulation of grain structure formation in the sample using a two-dimensional cellular automaton-finite element (CA-FE) model. In situ characterization of the columnar-to-equiaxed transition in a refined Al-3.5 wt.% Ni alloy is achieved by synchrotron X-ray radiography. Two main characteristics are derived from the radiographs for each nucleated grain, namely the nucleation position in the sample and the orientation of the main trunk relative to the vertical temperature gradient. These data are then used as input for the CA-FE simulations. The CA-FE model takes into account the effects of macroscopic transport of heat, liquid momentum and solute mass on the development of the dendritic grain structure and vice versa. The influence of convection on macroscopic shape of the growth front, the grain structure, the microstructure distribution and macro-segregation is determined by a comparison between the experimental observations and results from the numerical simulations with and without fluid flow. Good qualitative agreement is obtained and limitations that are linked to the two-dimensional approximation and the need for direct tracking of the eutectic grain structure are pointed out.