No recent searches
Popular Articles
Sorry! nothing found for
Posted over 2 years ago by Mat Valen
i am trying to deploy with scrapy 2.8 when i deploy the requirements.txt file i get these errors, does anyone have any idea what it could be? Login succeeded
Building an image:
Step 1/12 : FROM scrapinghub/scrapinghub-stack-scrapy:2.0
# Executing 5 build trigger
s
---> Using cache
---> 174fb002bc93
Step 2/12 : ENV PYTHONUSERBASE=/app/python
---> 62f4f6110a6e
Step 3/12 : ADD eggbased-entrypoint /usr/local/sbin/
---> 2e8007f27616
Step 4/12 : ADD run-pipcheck /usr/local/bin/
---> 1478a0f5a20b
Step 5/12 : RUN chmod +x /usr/local/bin/run-pipcheck
---> 716a797504e1
Step 6/12 : RUN chmod +x /usr/local/sbin/eggbased-entrypoint && ln -sf /usr/local/sbin/eggbased-entrypoint /usr/local/sbin/start-crawl && ln -sf /usr/local/sbin/eggbased-entrypoint /usr/local/sbin/scrapy-list && ln -sf /usr/local/sbin/eggbased-entrypoint /usr/local/sbin/shub-image-info && ln -sf /usr/local/sbin/eggbased-entrypoint /usr/local/sbin/run-pipcheck
---> ef0d9a109708
Step 7/12 : ADD requirements.txt /app/requirements.txt
---> 023905a25a4e
Step 8/12 : RUN mkdir /app/python && chown nobody:nogroup /app/python
---> a70182cc20a8
Step 9/12 : RUN sudo -u nobody -E PYTHONUSERBASE=$PYTHONUSERBASE -E PIP_NO_CACHE_DIR=0 pip install --user --no-cache-dir -r /app/requirements.txt
---> b7ddd2e34177
Step 10/12 : COPY *.egg /app/
---> cb15caf58757
Step 11/12 : RUN if [ -d "/app/addons_eggs" ]; then rm -f /app/*.dash-addon.egg; fi
---> Running in 93ae757cce44
Removing intermediate container 93ae757cce44
---> 5664ec9aede3
Step 12/12 : ENV PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
---> Running in d9835cfc540d
Removing intermediate container d9835cfc540d
---> 8d2654977f14
Successfully built 8d2654977f14
Successfully tagged i.scrapinghub.com/kumo_project/644946:29
Step 1/3 : FROM alpine:3.5
---> f80194ae2e0c
Step 2/3 : ADD kumo-entrypoint /kumo-entrypoint
---> bd44dae40011
Step 3/3 : RUN chmod +x /kumo-entrypoint
---> 4414cc5cd408
Successfully built 4414cc5cd408
Successfully tagged kumo-entrypoint:latest
Entrypoint container is created successfully
>>> Checking python dependencies
Collecting pip<20.0,>=9.0.3
Downloading pip-19.3.1-py2.py3-none-any.whl (1.4 MB)
Installing collected packages: pip
Successfully installed pip-19.3.1
botocore 1.16.14 has requirement jmespath<1.0.0,>=0.7.1, but you have jmespath 1.0.1.
botocore 1.16.14 has requirement urllib3<1.26,>=1.20; python_version != "3.4", but you have urllib3 1.26.15.
boto3 1.13.14 has requirement jmespath<1.0.0,>=0.7.1, but you have jmespath 1.0.1.
Warning: Pip checks failed, please fix the conflicts.
WARNING: There're some errors when doing pip-check:
WARNING: Ignoring invalid distribution -main- (/app/__main__.egg)
WARNING: The scripts pip, pip3 and pip3.8 are installed in '/app/python/bin' which is not on PATH.
Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
{"error": "requirements_error", "message": "Dependencies check exit code: 1", "details": "Pip checks failed, please fix the conflicts"}
my requiremets.txt attrs==22.2.0
Automat==22.10.0
certifi==2022.12.7
cffi==1.15.1
charset-normalizer==3.1.0
constantly==15.1.0
cryptography==40.0.1
cssselect==1.2.0
dropbox==11.36.0
et-xmlfile==1.1.0
filelock==3.10.7
hyperlink==21.0.0
idna==3.4
incremental==22.10.0
itemadapter==0.7.0
itemloaders==1.0.6
jmespath==1.0.1
lxml==4.9.2
numpy==1.24.2
openpyxl==3.1.2
packaging==23.0
pandas==1.5.3
parsel==1.7.0
ply==3.11
Protego==0.2.1
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
PyDispatcher==2.0.7
pyOpenSSL==23.1.1
python-dateutil==2.8.2
pytz==2023.3
queuelib==1.6.2
requests==2.28.2
requests-file==1.5.1
service-identity==21.1.0
six==1.16.0
stone==3.3.1
tldextract==3.4.0
Twisted==22.10.0
typing_extensions==4.5.0
urllib3==1.26.15
w3lib==2.1.1
zope.interface==6.0
0 Votes
1 Comments
Sergey Geron posted over 2 years ago Admin
Hi Mat, this is Sergey Geron, Business Analyst at Zyte.
Thank you for reaching out through our Forum.
Could you please create a support ticket here - https://support.zyte.com/support/tickets/new
Login to post a comment
People who like this
This post will be deleted permanently. Are you sure?
We use cookies to try and give you a better experience in Freshdesk.
You can learn more about what kind of cookies we use, why, and how from our Privacy Policy. If you hate cookies, or are just on a diet, you can disable them altogether too. Just note that the Freshdesk service is pretty big on some cookies (we love the choco-chip ones), and some portions of Freshdesk may not work properly if you disable cookies.
We’ll also assume you agree to the way we use cookies and are ok with it as described in our Privacy Policy, unless you choose to disable them altogether through your browser.
i am trying to deploy with scrapy 2.8 when i deploy the requirements.txt file i get these errors, does anyone have any idea what it could be? Login succeeded
Building an image:
Step 1/12 : FROM scrapinghub/scrapinghub-stack-scrapy:2.0
# Executing 5 build trigger
s
---> Using cache
---> Using cache
---> Using cache
---> Using cache
---> Using cache
---> 174fb002bc93
Step 2/12 : ENV PYTHONUSERBASE=/app/python
---> Using cache
---> 62f4f6110a6e
Step 3/12 : ADD eggbased-entrypoint /usr/local/sbin/
---> Using cache
---> 2e8007f27616
Step 4/12 : ADD run-pipcheck /usr/local/bin/
---> Using cache
---> 1478a0f5a20b
Step 5/12 : RUN chmod +x /usr/local/bin/run-pipcheck
---> Using cache
---> 716a797504e1
Step 6/12 : RUN chmod +x /usr/local/sbin/eggbased-entrypoint && ln -sf /usr/local/sbin/eggbased-entrypoint /usr/local/sbin/start-crawl && ln -sf /usr/local/sbin/eggbased-entrypoint /usr/local/sbin/scrapy-list && ln -sf /usr/local/sbin/eggbased-entrypoint /usr/local/sbin/shub-image-info && ln -sf /usr/local/sbin/eggbased-entrypoint /usr/local/sbin/run-pipcheck
---> Using cache
---> ef0d9a109708
Step 7/12 : ADD requirements.txt /app/requirements.txt
---> Using cache
---> 023905a25a4e
Step 8/12 : RUN mkdir /app/python && chown nobody:nogroup /app/python
---> Using cache
---> a70182cc20a8
Step 9/12 : RUN sudo -u nobody -E PYTHONUSERBASE=$PYTHONUSERBASE -E PIP_NO_CACHE_DIR=0 pip install --user --no-cache-dir -r /app/requirements.txt
---> Using cache
---> b7ddd2e34177
Step 10/12 : COPY *.egg /app/
---> cb15caf58757
Step 11/12 : RUN if [ -d "/app/addons_eggs" ]; then rm -f /app/*.dash-addon.egg; fi
---> Running in 93ae757cce44
Removing intermediate container 93ae757cce44
---> 5664ec9aede3
Step 12/12 : ENV PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
---> Running in d9835cfc540d
Removing intermediate container d9835cfc540d
---> 8d2654977f14
Successfully built 8d2654977f14
Successfully tagged i.scrapinghub.com/kumo_project/644946:29
Step 1/3 : FROM alpine:3.5
---> f80194ae2e0c
Step 2/3 : ADD kumo-entrypoint /kumo-entrypoint
---> Using cache
---> bd44dae40011
Step 3/3 : RUN chmod +x /kumo-entrypoint
---> Using cache
---> 4414cc5cd408
Successfully built 4414cc5cd408
Successfully tagged kumo-entrypoint:latest
Entrypoint container is created successfully
>>> Checking python dependencies
Collecting pip<20.0,>=9.0.3
Downloading pip-19.3.1-py2.py3-none-any.whl (1.4 MB)
Installing collected packages: pip
Successfully installed pip-19.3.1
botocore 1.16.14 has requirement jmespath<1.0.0,>=0.7.1, but you have jmespath 1.0.1.
botocore 1.16.14 has requirement urllib3<1.26,>=1.20; python_version != "3.4", but you have urllib3 1.26.15.
boto3 1.13.14 has requirement jmespath<1.0.0,>=0.7.1, but you have jmespath 1.0.1.
Warning: Pip checks failed, please fix the conflicts.
WARNING: There're some errors when doing pip-check:
WARNING: Ignoring invalid distribution -main- (/app/__main__.egg)
WARNING: Ignoring invalid distribution -main- (/app/__main__.egg)
WARNING: Ignoring invalid distribution -main- (/app/__main__.egg)
WARNING: The scripts pip, pip3 and pip3.8 are installed in '/app/python/bin' which is not on PATH.
Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
{"error": "requirements_error", "message": "Dependencies check exit code: 1", "details": "Pip checks failed, please fix the conflicts"}
my requiremets.txt attrs==22.2.0
Automat==22.10.0
certifi==2022.12.7
cffi==1.15.1
charset-normalizer==3.1.0
constantly==15.1.0
cryptography==40.0.1
cssselect==1.2.0
dropbox==11.36.0
et-xmlfile==1.1.0
filelock==3.10.7
hyperlink==21.0.0
idna==3.4
incremental==22.10.0
itemadapter==0.7.0
itemloaders==1.0.6
jmespath==1.0.1
lxml==4.9.2
numpy==1.24.2
openpyxl==3.1.2
packaging==23.0
pandas==1.5.3
parsel==1.7.0
ply==3.11
Protego==0.2.1
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
PyDispatcher==2.0.7
pyOpenSSL==23.1.1
python-dateutil==2.8.2
pytz==2023.3
queuelib==1.6.2
requests==2.28.2
requests-file==1.5.1
service-identity==21.1.0
six==1.16.0
stone==3.3.1
tldextract==3.4.0
Twisted==22.10.0
typing_extensions==4.5.0
urllib3==1.26.15
w3lib==2.1.1
zope.interface==6.0
0 Votes
1 Comments
Sergey Geron posted over 2 years ago Admin
Hi Mat, this is Sergey Geron, Business Analyst at Zyte.
Thank you for reaching out through our Forum.
Could you please create a support ticket here - https://support.zyte.com/support/tickets/new
0 Votes
Login to post a comment