Update Chat Interface examples and add more LLM libraries and API providers #10025
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
🪼 branch checks and previews
Install Gradio from this PR pip install https://gradio-pypi-previews.s3.amazonaws.com/ecd69f364b6da57c6324add75499f0a6a7e50f52/gradio-5.6.0-py3-none-any.whlInstall Gradio Python Client from this PR pip install "gradio-client @ git+https://github.com/gradio-app/gradio@ecd69f364b6da57c6324add75499f0a6a7e50f52#subdirectory=client/python"Install Gradio JS Client from this PR npm install https://gradio-npm-previews.s3.amazonaws.com/ecd69f364b6da57c6324add75499f0a6a7e50f52/gradio-client-1.8.0.tgzUse Lite from this PR <script type="module" src="https://gradio-lite-previews.s3.amazonaws.com/ecd69f364b6da57c6324add75499f0a6a7e50f52/dist/lite.js""></script> |
🦄 no changes detectedThis Pull Request does not include changes to any packages.__No changes detected. __
|
| for file in message["files"]: | ||
| files.append(file) | ||
|
|
||
| documents = SimpleDirectoryReader(input_files=files).load_data() |
There was a problem hiding this comment.
These should be created outside the function since the source document doesn't change?
Maybe we can make this a "chat with your document" type-demo instead and keep the function as is.
| history_transformer_format = list(zip(history[:-1], history[1:])) + [[message, ""]] | ||
| stop = StopOnTokens() | ||
|
|
||
| messages = "".join(["".join(["\n<human>:"+item[0], "\n<bot>:"+item[1]]) |
There was a problem hiding this comment.
This code is now outdated. you don't have to apply the chat template yourself since transformers supports the role/content dictionary conversation format.
I think the streaming can also be simplified but not sure.
|
Can we add these as starters in the playground? Trying to think of ways to make these more visible cc @aliabd 
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Fixed demos for OpenAI and Langchain. Added more examples for Llama Index, SambaNova, and Hyperbolic AI
Closes: #10003