No recent searches
Popular Articles
Sorry! nothing found for
Posted 10 months ago by Tylletsun
data = pkgutil.get_data("project", "resources/x-jobs-402313-cc765b1e2c6f.json")json_path = "/resources/x-jobs-402313-cc765b1e2c6f.json"os.environ['GOOGLE_APPLICATION_CREDENTIALS'] = json_path class MeetJobSpider(scrapy.Spider): name = "meet_job" custom_settings = { 'FEEDS': {f'gs://scrapy_output_test/meet_job/meet_job_{str(utc8_date)}.csv': {'format': 'csv', 'overwrite': True}} }I want to use feeds to upload data to gcs, I have sucessfully upload to GCS in local, but when in zyte, the file isn't upload and there is no error. The json is my api key. Please Help!
class MeetJobSpider(scrapy.Spider): name = "meet_job" custom_settings = { 'FEEDS': {f'gs://scrapy_output_test/meet_job/meet_job_{str(utc8_date)}.csv': {'format': 'csv', 'overwrite': True}} }
Attachments (1)
_E6_88_AA_E5....png40.8 KB
0 Votes
0 Comments
Login to post a comment
People who like this
This post will be deleted permanently. Are you sure?
We use cookies to try and give you a better experience in Freshdesk.
You can learn more about what kind of cookies we use, why, and how from our Privacy Policy. If you hate cookies, or are just on a diet, you can disable them altogether too. Just note that the Freshdesk service is pretty big on some cookies (we love the choco-chip ones), and some portions of Freshdesk may not work properly if you disable cookies.
We’ll also assume you agree to the way we use cookies and are ok with it as described in our Privacy Policy, unless you choose to disable them altogether through your browser.
Attachments (1)
_E6_88_AA_E5....png
40.8 KB
0 Votes
0 Comments
Login to post a comment