Live LLM and AI streaming workflow with Python

We will be working with async and streaming requests and responses from both hosted AI APIs and self-hosted LLMs to enhance the python development workflow. For example, we can avoid using ChatGPT for more explicit prompting being streamed directly in your python interpreter. We will most likely use AI21 Lab’s AI API and model weights for the demo, though we can be AI model agnostic.