On our game project we use a data tool that allows you to create tables of data out of columns with specific data types as well as references to other table rows.
When you export from the tool it creates data files but also generates the C++ struct that represents the schema. The loader simply mmaps the data in to memory. Variable length data like strings gets packed at the end of the table with the fixed length records containing relative pointers in to it.
The data on disk is stored in the exact format that is needed at run time.
References to rows in other tables turn in to pointer like objects so you get a perfectly natural syntax as if the data had been loaded in to hand written classes.
It's perfect for rapid development because designers can add new columns or tables of data and then just tell the programmer what they are called.
It also loads lightning fast and has excellent run time properties due to cache coherency.
On our game project we use a data tool that allows you to create tables of data out of columns with specific data types as well as references to other table rows.
When you export from the tool it creates data files but also generates the C++ struct that represents the schema. The loader simply mmaps the data in to memory. Variable length data like strings gets packed at the end of the table with the fixed length records containing relative pointers in to it.
The data on disk is stored in the exact format that is needed at run time.
References to rows in other tables turn in to pointer like objects so you get a perfectly natural syntax as if the data had been loaded in to hand written classes.
It's perfect for rapid development because designers can add new columns or tables of data and then just tell the programmer what they are called.
It also loads lightning fast and has excellent run time properties due to cache coherency.