@waylonwalker's thoughts

2023

duckdb can just query any pandas dataframe that is in memory.

I tried running it against a list of objects and got this error. Great error message that gives me supported types right in the message.


Make sure that "posts" is either a pandas.DataFrame, duckdb.DuckDBPyRelation, pyarrow Table, Dataset, RecordBatchReader, Scanner, or NumPy ndarrays with supported format
https://duckdb.org/docs/guides/python/sql_on_pandas