Skip to content

[Bug] Error while downloading model #1024

Description

@arajawat

Describe the issue

Facing following error in selected networks while downloading models.

PS C:\Users\arajawat> foundry run phi-3.5-mini
■ Downloading model (phi-3.5-mini-instruct-qnn-npu:3, 2.0 GB)

phi-3.5-mini-instruct-qnn-npu:3 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━   0% 0.0/2.0 GB ?/s --:--:-- ⠏

● error: IPC error 'op_handler_failed': Error downloading model phi-3.5-mini-instruct-qnn-npu:3: Error:
Microsoft.Neutron.Downloader.RegionFallbackException: Registry request failed across 8 region(s):
centralindia(timeout), southindia(timeout), jioindiawest(timeout), southeastasia(timeout), uaenorth(timeout),
westeurope(timeout), eastus(timeout), westus2(timeout).
---> System.Threading.Tasks.TaskCanceledException: A task was canceled.
---> System.Threading.Tasks.TaskCanceledException: A task was canceled.
   at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.<WaitWithCancellationAsync>d__1.MoveNext() +
0x100
--- End of stack trace from previous location ---
   at System.Net.Http.HttpConnectionPool.<SendWithVersionDetectionAndRetryAsync>d__50.MoveNext() + 0x928
--- End of stack trace from previous location ---
   at System.Net.Http.RedirectHandler.<SendAsync>d__4.MoveNext() + 0x1d4
--- End of stack trace from previous location ---
   at System.Net.Http.HttpClient.<<SendAsync>g__Core|83_0>d.MoveNext() + 0xa0
   --- End of inner exception stack trace ---
   at System.Net.Http.HttpClient.HandleFailure(Exception, Boolean, HttpResponseMessage, CancellationTokenSource,
CancellationToken, CancellationTokenSource) + 0x380
   at System.Net.Http.HttpClient.<<SendAsync>g__Core|83_0>d.MoveNext() + 0x3a8
--- End of stack trace from previous location ---
   at Microsoft.Neutron.Downloader.AzureExtensions.<SendRegistryRequestAsync>d__47.MoveNext() + 0xbc
--- End of stack trace from previous location ---
   at
Microsoft.Neutron.Downloader.AzureExtensions.<>c__DisplayClass46_0.<<GetModelContainer>g__Attempt|0>d.MoveNext() +
0x21c
--- End of stack trace from previous location ---
   at Microsoft.Neutron.Downloader.RegionFallback.<ExecuteWithFallbackAsync>d__22`1.MoveNext() + 0x390
   --- End of inner exception stack trace ---
   at Microsoft.Neutron.Downloader.RegionFallback.<ExecuteWithFallbackAsync>d__22`1.MoveNext() + 0x8ec
--- End of stack trace from previous location ---
   at Microsoft.Neutron.Downloader.AzureExtensions.<GetModelContainer>d__46.MoveNext() + 0x64
--- End of stack trace from previous location ---
   at
Microsoft.Neutron.Downloader.AzureExtensions.<>c__DisplayClass39_0.<<AzureFoundryDownloaderAsync>b__0>d.MoveNext() +
0x80
--- End of stack trace from previous location ---
   at Microsoft.Neutron.Downloader.AzureExtensions.<AzureDownloadAsyncImpl>d__41.MoveNext() + 0x398
--- End of stack trace from previous location ---
   at Microsoft.Neutron.Downloader.AzureExtensions.<AzureDownloadAsyncImpl>d__41.MoveNext() + 0x1490
--- End of stack trace from previous location ---
   at Microsoft.Neutron.OpenAI.Provider.AzureFoundryLocalDownloadClientProvider.<DownloadModelAsync>d__4.MoveNext()
+ 0x70
--- End of stack trace from previous location ---
   at Microsoft.AI.Foundry.Local.AzureModelCatalog.<DownloadModelAsync>d__20.MoveNext() + 0x248
--- End of stack trace from previous location ---
   at
Microsoft.AI.Foundry.Local.NativeInterop.<>c__DisplayClass13_0.<<ExecuteCommandWithCallbackManaged>b__0>d.MoveNext()
+ 0x88
--- End of stack trace from previous location ---
   at Microsoft.AI.Foundry.Local.NativeInterop.<ExecuteWithTracker>d__9.MoveNext() + 0xac
Hint: Try 'foundry server stop' then 'foundry server start'.

To reproduce

Happened only on some selective network, however I am able to browse internet and do any other thing normally on same network.

Urgency

No response

Platform and architecture

Windows X64

OS Version

Windows 11

Installation type

Released package/binary

Foundry Local version

cli

API or surface area

CLI

Hardware acceleration/backend

Other / Unknown

Backend/runtime version

No response

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions