scrapy / scrapy

Compare 23cfdb0 ... +0 ... e876d8e

Coverage Reach
core/downloader/handlers/http11.py core/downloader/handlers/http2.py core/downloader/handlers/ftp.py core/downloader/handlers/__init__.py core/downloader/handlers/s3.py core/downloader/handlers/http10.py core/downloader/handlers/datauri.py core/downloader/handlers/file.py core/downloader/handlers/http.py core/downloader/__init__.py core/downloader/webclient.py core/downloader/middleware.py core/downloader/contextfactory.py core/downloader/tls.py core/http2/protocol.py core/http2/stream.py core/http2/agent.py core/engine.py core/scraper.py core/scheduler.py core/spidermw.py utils/python.py utils/misc.py utils/conf.py utils/iterators.py utils/defer.py utils/log.py utils/datatypes.py utils/deprecate.py utils/test.py utils/request.py utils/console.py utils/reactor.py utils/curl.py utils/project.py utils/url.py utils/signal.py utils/response.py utils/ssl.py utils/testproc.py utils/trackref.py utils/spider.py utils/benchserver.py utils/testsite.py utils/serialize.py utils/decorators.py utils/display.py utils/sitemap.py utils/gz.py utils/ftp.py utils/engine.py utils/boto.py utils/template.py utils/ossignal.py utils/versions.py utils/reqser.py utils/httpobj.py utils/job.py utils/asyncgen.py utils/py36.py extensions/feedexport.py extensions/httpcache.py extensions/memusage.py extensions/telnet.py extensions/throttle.py extensions/closespider.py extensions/debug.py extensions/logstats.py extensions/corestats.py extensions/spiderstate.py extensions/statsmailer.py extensions/memdebug.py commands/parse.py commands/genspider.py commands/startproject.py commands/__init__.py commands/check.py commands/runspider.py commands/fetch.py commands/shell.py commands/bench.py commands/settings.py commands/edit.py commands/crawl.py commands/version.py commands/view.py commands/list.py http/request/form.py http/request/__init__.py http/request/json_request.py http/request/rpc.py http/response/text.py http/response/__init__.py http/response/html.py http/response/xml.py http/cookies.py http/headers.py http/__init__.py http/common.py downloadermiddlewares/httpcache.py downloadermiddlewares/cookies.py downloadermiddlewares/robotstxt.py downloadermiddlewares/httpcompression.py downloadermiddlewares/redirect.py downloadermiddlewares/retry.py downloadermiddlewares/decompression.py downloadermiddlewares/httpproxy.py downloadermiddlewares/ajaxcrawl.py downloadermiddlewares/stats.py downloadermiddlewares/httpauth.py downloadermiddlewares/useragent.py downloadermiddlewares/downloadtimeout.py downloadermiddlewares/defaultheaders.py pipelines/files.py pipelines/media.py pipelines/images.py pipelines/__init__.py settings/__init__.py settings/default_settings.py spidermiddlewares/referer.py spidermiddlewares/offsite.py spidermiddlewares/depth.py spidermiddlewares/httperror.py spidermiddlewares/urllength.py spiders/crawl.py spiders/__init__.py spiders/feed.py spiders/sitemap.py spiders/init.py exporters.py contracts/__init__.py contracts/default.py crawler.py linkextractors/lxmlhtml.py linkextractors/__init__.py shell.py cmdline.py pqueues.py squeues.py mail.py robotstxt.py item.py resolver.py responsetypes.py dupefilters.py middleware.py statscollectors.py spiderloader.py logformatter.py selector/unified.py selector/__init__.py exceptions.py loader/__init__.py loader/processors.py loader/common.py signals.py signalmanager.py __init__.py link.py extension.py interfaces.py __main__.py

No flags found

Use flags to group coverage reports by test type, project and/or folders.
Then setup custom commit statuses and notifications for each flag.

e.g., #unittest #integration

#production #enterprise

#frontend #backend

Learn more about Codecov Flags here.


@@ -283,9 +283,9 @@
Loading
283 283
            if omitConnectTunnel:
284 284
                warnings.warn(
285 285
                    "Using HTTPS proxies in the noconnect mode is deprecated. "
286 -
                    "If you use Zyte Smart Proxy Manager (formerly Crawlera), "
287 -
                    "it doesn't require this mode anymore, so you should "
288 -
                    "update scrapy-crawlera to 1.3.0+ and remove '?noconnect' "
286 +
                    "If you use Zyte Smart Proxy Manager, it doesn't require "
287 +
                    "this mode anymore, so you should update scrapy-crawlera "
288 +
                    "to scrapy-zyte-smartproxy and remove '?noconnect' "
289 289
                    "from the Zyte Smart Proxy Manager URL.",
290 290
                    ScrapyDeprecationWarning,
291 291
                )

@@ -72,10 +72,14 @@
Loading
72 72
            proxy_host = proxy_host.decode()
73 73
            omit_connect_tunnel = b'noconnect' in proxy_params
74 74
            if omit_connect_tunnel:
75 -
                warnings.warn("Using HTTPS proxies in the noconnect mode is not supported by the "
76 -
                              "downloader handler. If you use Crawlera, it doesn't require this "
77 -
                              "mode anymore, so you should update scrapy-crawlera to 1.3.0+ "
78 -
                              "and remove '?noconnect' from the Crawlera URL.")
75 +
                warnings.warn(
76 +
                    "Using HTTPS proxies in the noconnect mode is not "
77 +
                    "supported by the downloader handler. If you use Zyte "
78 +
                    "Smart Proxy Manager, it doesn't require this mode "
79 +
                    "anymore, so you should update scrapy-crawlera to "
80 +
                    "scrapy-zyte-smartproxy and remove '?noconnect' from the "
81 +
                    "Zyte Smart Proxy Manager URL."
82 +
                )
79 83
80 84
            if scheme == b'https' and not omit_connect_tunnel:
81 85
                # ToDo

Everything is accounted for!

No changes detected that need to be reviewed.
What changes does Codecov check for?
Lines, not adjusted in diff, that have changed coverage data.
Files that introduced coverage data that had none before.
Files that have missing coverage data that once were tracked.
Files Coverage
scrapy 88.17%
Project Totals (162 files) 88.17%
Loading