[BUG] Cannot create a new crew if you are using a secure environment (eg not allowing remote connections)

[digiguru]

Description

Downloading crewai one would assume you can create a new crew without needing connections to the internet. Some environments require signing of certificates to ensure connections are valid and expected.

For example, when creating a new crew as specified in the startup instructions:

crewai create crew latest-ai-development

the output says...

Error fetching provider data
HTTPSConnectionPool(host='raw.githubusercontent.com', port=443): Max retries exceeded with url: /BerriAI/litellm/main/model_prices_and_context_window.json

Looking at this file it seems to just be a list of prices.

I'm not sure why such a file needs to be downloaded or what it's purpose serves, but in a secure environment it feels like it's unnecessary.

Is there a flag one can pass to skip this process or to allow trusted hosts? Pip for example has the --trusted-host flag

Steps to Reproduce

1. On a computer run pip install 'crewai[tools]'
2. Disconnect from the internet or enable a security platform like Netskope
3. Run crewai create crew latest-ai-development

Expected behavior

The scaffold for the application is setup without an error.

Screenshots/Code snippets

Error fetching provider data: HTTPSConnectionPool(host='raw.githubusercontent.com', port=443): Max retries exceeded with url: /BerriAI/litellm/main/model_prices_and_context_window.json (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x127ac7bc0>: Failed to resolve 'raw.githubusercontent.com' ([Errno 8] nodename nor servname provided, or not known)"))

Operating System

macOS Ventura

Python Version

3.12

crewAI Version

0.86.0

crewAI Tools Version

0.86.0

Virtual Environment

Venv

Evidence

Error fetching provider data: HTTPSConnectionPool(host='raw.githubusercontent.com', port=443): Max retries exceeded with url: /BerriAI/litellm/main/model_prices_and_context_window.json (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x127ac7bc0>: Failed to resolve 'raw.githubusercontent.com' ([Errno 8] nodename nor servname provided, or not known)"))

Possible Solution

Add flag to skip internet connections or for trusted domains

Additional context

Secure computer, requires whitelisted domain interaction

[theCyberTech]

This is not a bug, this file is the list of available model available from our LLM provider LiteLLM, but not prices

[jwhelland]

Agree that creating a crew with the cli should not require internet connectivity. Plenty of environments hosting their own LLMs that have limited or no outside connectivity.