Great article, Peter! Have you used llama-index at all? They provide a way to index your own data and interact with it using a prompt/response interface. Most of the tutorials use unstructured data but there is one using a SQL data base as well.