Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🐛 Bug: eos2thm fails with an EmptyOutputError locally but works fine on Colab #391

Closed
sayantani11 opened this issue Oct 19, 2022 · 15 comments
Assignees
Labels
bug Something isn't working help wanted Extra attention is needed

Comments

@sayantani11
Copy link
Contributor

sayantani11 commented Oct 19, 2022

Describe the bug.

The problem is similar to the one I faced in fetching eos1579 , but in that case the same problem was seen in both Colab & my local machine, but here the fetching & serving was very well done in Colab. I went through the logs, but it seems to show the similar error. I am still trying to figure out but will be thankful with some help.

Describe the steps to reproduce the behavior

No response

Expected behavior.

👍🏼Model eos2thm fetched successfully!

Screenshots.

eos2thm.txt

Operating environment

Ubuntu 18.04.5 LTS WSL2

Additional context

There's one thing I noticed whenever this happens is Status Code 500. I am trying to digging this if this can be a reason.

@sayantani11 sayantani11 added the bug Something isn't working label Oct 19, 2022
@Femme-js
Copy link
Contributor

@sayantani11 I am also having the same issue #338

@GemmaTuron
Copy link
Member

Hi @sayantani11

That is a very good indication that the problem we are facing is due to the setup on your local machine, if the model runs in colab the packages etc itself are well indicated. Can you paste the log file when you try it on your local machine or point me to the issue where it is?

@GemmaTuron
Copy link
Member

@sayantani11 I am also having the same issue #338

I see @Femme-js !

Ok, I'll need some time to look at what can be the problem and suggest a few things to try.

For both of you, let's mark these models in the excel file in purple and I am tagging this issue for further work on it!

@GemmaTuron GemmaTuron added help wanted Extra attention is needed model-bug labels Oct 19, 2022
@sayantani11
Copy link
Contributor Author

Hi @sayantani11

That is a very good indication that the problem we are facing is due to the setup on your local machine, if the model runs in colab the packages etc itself are well indicated. Can you paste the log file when you try it on your local machine or point me to the issue where it is?

I did upload the log file, guess there were some errors while uploading
Here it is:
eos2thm.txt

@Femme-js
Copy link
Contributor

Okay, @GemmaTuron for now I will mark these models purple.

@GemmaTuron
Copy link
Member

GemmaTuron commented Oct 20, 2022

Hi @sayantani11
That is a very good indication that the problem we are facing is due to the setup on your local machine, if the model runs in colab the packages etc itself are well indicated. Can you paste the log file when you try it on your local machine or point me to the issue where it is?

I did upload the log file, guess there were some errors while uploading Here it is: eos2thm.txt

Thanks I can see it now!
Seems like the Git LFS error is persisting @sayantani11 ! let's try to solve this
When you run git-lfs --help (or any other git lfs command, I am not sure which ones are available) inside ersilia's conda environment, do you get the correct output?

@GemmaTuron
Copy link
Member

GemmaTuron commented Oct 21, 2022

Thanks I can see it now! Seems like the Git LFS error is persisting @sayantani11 ! let's try to solve this When you run git-lfs --help (or any other git lfs command, I am not sure which ones are available) inside ersilia's conda environment, do you get the correct output?

Hi @sayantani11,
We are creating an informative error for when Git LFS is not properly installed (see issue #277 ) but let's try to solve it for you meanwhile. I am suspecting you might have tried installing the windows version of git in your linux wsl. See this issue which can help you find the problem: git-lfs/git-lfs#2898

@GemmaTuron
Copy link
Member

@Femme-js still working on the model to identify what is going wrong.
The warning for chardet urllib is in #408 but that is not the root of the problem

Seems a memory error. Can you run ulimit on your bash and let me know your memory limit?

@sayantani11
Copy link
Contributor Author

Thanks I can see it now! Seems like the Git LFS error is persisting @sayantani11 ! let's try to solve this When you run git-lfs --help (or any other git lfs command, I am not sure which ones are available) inside ersilia's conda environment, do you get the correct output?

Hi @sayantani11, We are creating an informative error for when Git LFS is not properly installed (see issue #277 ) but let's try to solve it for you meanwhile. I am suspecting you might have tried installing the windows version of git in your linux wsl. See this issue which can help you find the problem: git-lfs/git-lfs#2898

when i do git-lfs it shows all the available commands.. and works fine

@GemmaTuron
Copy link
Member

Hi @sayantani11 !
This is annoying but is clear from the log error pasted above and in the issue #369 that ersilia is unable to find the git-lfs. Can you try once again the following as suggested in the issue above? Make sure you are inside the WLS:
(from: https://github.com/git-lfs/git-lfs/wiki/Installation#debian-and-ubuntu):
curl -s https://packagecloud.io/install/repositories/github/git-lfs/script.deb.sh | sudo bash
sudo apt-get install git-lfs
git lfs install

After that, reboot the system, fetch the model and paste the log here, hopefully it will not have the git-lfs command error anymore!

@Zainab-ik
Copy link
Collaborator

Hi @sayantani11 ! This is annoying but is clear from the log error pasted above and in the issue #369 that ersilia is unable to find the git-lfs. Can you try once again the following as suggested in the issue above? Make sure you are inside the WLS: (from: https://github.com/git-lfs/git-lfs/wiki/Installation#debian-and-ubuntu): curl -s https://packagecloud.io/install/repositories/github/git-lfs/script.deb.sh | sudo bash sudo apt-get install git-lfs git lfs install

After that, reboot the system, fetch the model and paste the log here, hopefully it will not have the git-lfs command error anymore!

In relation to this, inside your WSL, activate your ersilia environment and do the installation there, also initialize in the ersilia environment.
Then reboot your system and follow @GemmaTuron suggestion.

@sayantani11
Copy link
Contributor Author

Hi @sayantani11 ! This is annoying but is clear from the log error pasted above and in the issue #369 that ersilia is unable to find the git-lfs. Can you try once again the following as suggested in the issue above? Make sure you are inside the WLS: (from: https://github.com/git-lfs/git-lfs/wiki/Installation#debian-and-ubuntu): curl -s https://packagecloud.io/install/repositories/github/git-lfs/script.deb.sh | sudo bash sudo apt-get install git-lfs git lfs install

After that, reboot the system, fetch the model and paste the log here, hopefully it will not have the git-lfs command error anymore!

So I did all the above suggested solutions but the fetch still failed -
eos2thm.txt

@GemmaTuron
Copy link
Member

Hi @Femme-js , I am assigning this one to you as well to work together with #338

@GemmaTuron
Copy link
Member

Hi @miquelduranfrigola
I am leaving this issue open related to #338 - I think the problems are due to the size of the model which depending on the user bandwidth does not download.
Let's decide what we do with it

@GemmaTuron GemmaTuron moved this from Suggested to Done in Ersilia Model Hub Jan 16, 2023
@GemmaTuron
Copy link
Member

This has been solved by @HellenNamulinda

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

4 participants