Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Describe Image Phi 3.5 Vision CPU don't work or extremely slow #22

Open
khmyznikov opened this issue Nov 19, 2024 · 0 comments
Open
Labels
🐛bug Something isn't working 🤖 sample

Comments

@khmyznikov
Copy link

Describe the bug
With sample image it takes about 3-5 minutes to process but result is there.
But my own image immidiately falls into exception.

input sequence_length (2526) is >= max_length (2500)

 at Microsoft.ML.OnnxRuntimeGenAI.Result.VerifySuccess(IntPtr nativeResult)
   at Microsoft.ML.OnnxRuntimeGenAI.Generator..ctor(Model model, GeneratorParams generatorParams)
   at AIDevGallery.Samples.OpenSourceModels.MultimodalModels.DescribeImage.<InferStreaming>d__9.MoveNext() in X:\Github\ai-dev-gallery\AIDevGallery\Samples\Open Source Models\Multimodal Models\DescribeImage.xaml.cs:line 137
   at AIDevGallery.Samples.OpenSourceModels.MultimodalModels.DescribeImage.<InferStreaming>d__9.System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult(Int16 token)
   at AIDevGallery.Samples.OpenSourceModels.MultimodalModels.DescribeImage.<>c__DisplayClass11_0.<<LoadAndDescribeImage>b__0>d.MoveNext() in X:\Github\ai-dev-gallery\AIDevGallery\Samples\Open Source Models\Multimodal Models\DescribeImage.xaml.cs:line 203
   at AIDevGallery.Samples.OpenSourceModels.MultimodalModels.DescribeImage.<>c__DisplayClass11_0.<<LoadAndDescribeImage>b__0>d.MoveNext() in X:\Github\ai-dev-gallery\AIDevGallery\Samples\Open Source Models\Multimodal Models\DescribeImage.xaml.cs:line 203

Image

Windows DevKit Volterra

@niels9001 niels9001 changed the title [BUG] Describe Image Phi 3.5 Vision CPU don't work or extreamly slow [BUG] Describe Image Phi 3.5 Vision CPU don't work or extremely slow Nov 19, 2024
@nmetulev nmetulev added 🐛bug Something isn't working 🤖 sample labels Nov 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🐛bug Something isn't working 🤖 sample
Projects
None yet
Development

No branches or pull requests

2 participants