Forums

OSError: Tunnel connection failed: 403 Forbidden

I want to run a daily task that gets some small .json files and uses them to update a .txt file in my folder. To do this I use a wrapper library for the API I am accessing (brawlstats).

Running the task I get the error:

OSError: Tunnel connection failed: 403 Forbidden

As well as

urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.brawlapi.cf', port=443): Max retries exceeded with url: /v1/leaderboards/players?count=200&brawler=shelly (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden')))

I'd like to know how I could run daily tasks with outbound internet usage? Would it work if I bought a premium membership?

A paid account can be used to access any website, but there is a whitelist of APIs that can be accessed from free accounts. The PythonAnywhere devs can add any requested API to the whitelist. You must also provide a link to the API's documentation to request it.

+1 to what @dull says -- @brawlrank, if that's a documented public API that you're trying access, just send us a link to the API docs and we'll add it to the whitelist.

From my pythonAnywhere app I send a get request to a external webserver and in the console i get following error message, see below. Sending the same request in my mozilla forefox webbrowser I get a JSON response. Can you add the url to your pythonAnywhere white-list or do I need a paid account? Mayn thanks for your help. Fred59

Traceback (most recent call last): File "/home/Fred59status/mysite/flask_app.py", line 41, in <module> response_status = requests.get(urlAPI + order_id) # raise OSError("Tunnel connection failed: %d %s" % (code, OSError: Tunnel connection failed: 403 Forbidden File "/usr/lib/python3.8/site-packages/requests/api.py", line 75, in get return request('get', url, params=params, kwargs) File "/usr/lib/python3.8/site-packages/requests/api.py", line 60, in request return session.request(method=method, url=url, kwargs) File "/usr/lib/python3.8/site-packages/requests/sessions.py", line 533, in request resp = self.send(prep, send_kwargs) File "/usr/lib/python3.8/site-packages/requests/sessions.py", line 646, in send r = adapter.send(request, kwargs) File "/usr/lib/python3.8/site-packages/requests/adapters.py", line 510, in send raise ProxyError(e, request=request) requests.exceptions.ProxyError: HTTPSConnectionPool(host='www.vitaland.ch', port=443): Max retries exceeded with url: /scripts/get_order_data.php?api_key=XXXXXXXXXXXXXXXX &order_id=200496459 (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden')))

if you can show us public api documentation, then we can add it to the whitelist. Otherwise you may need to get a paid account.

Hi there!

Could you put url https://cti-taxii.mitre.org of Mitre TAXII API in PA Proxy Whitelist?

I'm getting this proxy error:

HTTPSConnectionPool(host='cti-taxii.mitre.org', port=443): Max retries exceeded with url: /stix/collections/95ecc380-afe9-11e4-9b6c-751b66dd541e/ (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden',)))

It's the Mitre service (Taxii), about cybersecurity

Link to *Public documentations about Mitre Taxii Service: *

No problem. I've added that to the whitelist.

Hi there Could you please add the url "https://www.worldometers.info/coronavirus/" "https://www.worldometers.info/coronavirus/country/ethiopia/" to the whitelist..

We can only whitelist sites with an official public API -- if that site has one, could you post a link to the API documentation?

https://www.who.int/data/gho/info/athena-api Ok...what about this...

Sure, I've whitelisted the host described on that page, apps.who.int.

can you whitelist 'https://www.worldometers.info/coronavirus/'

We can only whitelist sites with an official public API -- if that site has one, could you post a link to the API documentation?

Please! Can you add to whitelist https://developerhub.alfabank.by/.
Error: HTTPSConnectionPool(host='developerhub.alfabank.by', port=8273): Max retries exceeded with url: /token/ (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden',)))

It doesn't look like that will work, since that API appears to use a non-standard port. Free accounts can only connect out on ports 80 and 443 (the standard http and https ports), so adding that to the whitelist would have no effect.

if I switch to Hacker I be able to use request HTTPSConnectionPool(host='developerhub.alfabank.by', port=8273) without errors ?

Yes, if the errors you're getting are because it cannot connect to the site.

How quickly will my website work if I pay now and do I need to change something in the settings?

When you upgrade you need to restart consoles, web apps, etc. for it to take effect

Is it possible to whitelist my bot’s website so that I can use my API or do I need to make documentation?

When we whitelist a site, it's whitelisted for all free users (including people using the console on the front page of python.org), not just for one account. So your bot would need to offer a general public API that people could use before we could whitelist it.

Please! Can you add to whitelist https://api.sypexgeo.net/json/ requests.exceptions.ProxyError: HTTPSConnectionPool(host='api.sypexgeo.net', port=443): Max retries exceeded with url: /json/ (Caused by ProxyError('Cannot connect to proxy.', OSErr or('Tunnel connection failed: 403 Forbidden'))) https://sypexgeo.net/ru/api/ - official Rest API Doc Thank you

Sure! That's whitelisted now.

Can I ask you to add this API to the list? https://twelvedata.com/docs

And one more: https://currency.com/api

No problem,

    api-adapter.backend.currency.com
    api.twelvedata.com

were added to the whitelist

Thank you. Eeverything works fine.

Thanks for confirming!

please add https://ghibliapi.herokuapp.com too

It's done

Will you please add "api.segment.io" to the whitelist? https://segment.com/docs/connections/sources/catalog/libraries/server/http-api/

We've already added that in response to your email.

please add this https://www.worldometers.info/coronavirus/#countries

Hello Sir, Can you please add "https://api.elis.rossum.ai/docs/#getting-started" to whitelist. I am getting the following error: HTTPSConnectionPool(host='api.elis.rossum.ai', port=443): Max retries exceeded with url: /v1/queues/46510/upload (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden')))

Sure, we have added api.elis.rossum.ai to the whitelist.

@stonieplus please provide the api documentation if you want the url to be considered for our whitelist.

Thanks Sir! :)

please add this to whitelist "https://covid-19india-api.herokuapp.com/all" api doc https://covid-19india-api.herokuapp.com/

No problem. I have added that to the whitelist.

Hi, I'm having the same trouble here. Something like "OSError: Tunnel connection failed: 403 Forbidden" It'd nice if you could add this page to the whitelist. I'm not very into programming stuff, just learning, so I don't know what the API of this page is, but at least I can give you the page, it's a page from an argentinian university, so I think it's nothing malicious. The page is https://www.info.unlp.edu.ar/ . Thanks.

I don't see any reference to an API on that page, so it's probably not a candidate for the whitelist.

Hi, I think I may having the same problem. My apps gets some data from UNIDATA (https://www.unidata.ucar.edu/), via siphon library, and I get the same error : Max retries exceeded with url: /thredds/catalog.xml (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden')))

Siphon API documentation: https://unidata.github.io/siphon/latest/api/index.html

Would it be possible to add this site to the whitelist? I am using a free account, and it's for learning purposes Kind Regards, Guillermo.

Is there a page on www.unidata.ucar.edu itself that says that the site is an official public API of some kind? Or alternatively, a link from there saying that https://unidata.github.io/siphon/ is something that they themselves maintain?

thanks, Maybe this is what you are asking? https://unidata.github.io/siphon/latest/ Kind regards, Guillermo

Hi! Can you guys please add Carris to the whitelist? It is Lisbon, Portugal bus provider.

API: https://carris.tecmic.com/api/v2.9/ Documentation: https://carris.tecmic.com/index.html

sure, we have added carris.tecmic.com to the whitelist for you.

@gguevara we would need something on www.unidata.ucar.edu not unidata.github.io

Pls can you add www.flipkart.com to whitelist.. Or If I taks hacker subscription so that i can access it through python

Pls can you add www.flipkart.com to whitelist.. Or If I taks hacker subscription so that i can access it through python and bit.ly

We can only add sites if they have official public APIs; we've already whitelisted Flipkart and Bitly's APIs; the domains you list aren't part of those APIs.

Paid accounts have unrestricted Internet access and can access sites that are not on the whitelist.

if they are whitelisted but still i get error 403 so after taking pythonanywhere hacker subscription ca i access it? pls reply

if they are not part of apis so after subscription can i access it ?

If you upgrade to a paying account, we do not limit your outbound internet connections. However, if you are trying to say scrape a site, that site can still choose to block you even though we don't do anything on our end.

If we already have the api on our whitelist and you are getting a 403, then you should probably try to fix it from a free account first.

Hello, could you please add https://dashboard.blomp.com/dashboard/ to whitelist. His Api doc was https://www.blomp.com/ . Thank you

That does not look like API documentation to me (it just looks like the front page of a service) and I couldn't see anything that looked like it would link to API documentation.

Hello, could you please add https://dashboard.blomp.com/dashboard/ to whitelist. It just a website that offer cloud storage. I don't know if his Api doc was www.blomp.com/privacy-policy/. Thank you

Hello, dear admins. May I ask you to whitelist url https://thispersondoesnotexist.com/ please? API: https://github.com/David-Lor/ThisPersonDoesNotExistAPI This site generates random faces, and I wrote a bot that adds them to instagram so that later they can be used for AI training.

But I am getting error: requests.exceptions.ProxyError: HTTPSConnectionPool (host = 'thispersondoesnotexist.com', port = 443): Max retries exceeded with url: / image (Caused by ProxyError ('Cannot connect to proxy.', OSError ('Tunnel connection failed: 403 Forbidden ')))

Everything works fine on my computer

Hello, could you please add https://dashboard.blomp.com/dashboard/ to whitelist. It just a website that offer cloud storage. I don't know if his Api doc was www.blomp.com/privacy-policy/. Thank you

Hello guys o/ Is it possible to add https://developer.dhl.com/api-reference/shipment-tracking#get-started-section/user-guide to your whitelist?

Cheers

it's DHL's parcels tracking API :)

@tboard -- we can only whitelist sites if they have an official public API, so if that site has one you'll need to give us a link to the API docs. If it doesn't have an API, we can't whitelist it.

@supervit -- the API needs to be an official public one, and that is just a github repository where someone has created an unofficial API.

@goldfingers95 -- sure! The docs you link to say that the API is at api-eu.dhl.com, so we've whitelisted that.

Thank you Admin. As for the https://dashboard.blomp.com/dashboard/ I asked you to add to whitelist. This is what I got from the blomp agent.

For the most part, the Blomp API is the Openstack Swift API:

https://docs.openstack.org/swift/latest/

Thanks.

What we really need is a link to some page on blomp.com specifying what the API is, and what hostname it uses.

Many requests have been made for www.worldometers.info to be whitelisted.I have the same request.But like the others,I don't have the API. Is there any way to work with this website without a problem?

If the site does not have a publicly documented API, then we cannot add it to the whitelist. If you want to scrape the site, you will need a paid account.

Hi Guys, can you please add https://www.freshbooks.com/classic-api to the whitelist please?

The URL for that API is based on your account name, so it's not something that is a candidate for the whitelist.

please: pesmaster.com/api/

@fabvitor please provide the api documentation if you want the url to be considered for our whitelist.

I guessed I have problem with whitelisting for https://api.windy.com/

Documentation 'https://api.windy.com/point-forecast/docs'

I have a demo tomorrow Could you please helpme out

Also following API : http://forefire.univ-corse.fr/?page=api/v1/jsdoc/index.html

Could this be whitelisted?

No problem. I have added api.windy.com and forefire.univ-corse.fr to the whitelist.

Hi! Would it be possible to whitelist https://projects.fivethirtyeight.com/soccer-api/club/spi_matches_latest.csv ?

And would this be enough for a documentation?: https://github.com/fivethirtyeight/data/tree/master/soccer-spi

Thank you.

Yes, I've just added projects.fivethirtyeight.com to our whitelist for you.

Can you add "https://vjudge.net" in whitelist ?

Can you add these websites in whilelist ? "https://uhunt.onlinejudge.org/api" , "https://vjudge.net", "https://www.stopstalk.com/user/profile", "https://codeforces.com/api/user.status?"

codeforces.com is already whitelisted

I added uhunt.onlinejudge.org

For vjudge.net and www.stopstalk.com we need docs.

i dont get it which types of docs you are talking about?

Official api docs that mention endpoints.

Hello Sir, Can you please add "https://goodinfo.tw/" to whitelist. I am getting the following error: HTTPSConnectionPool(host='goodinfo.tw', port=443): Max retries exceeded with url: /StockInfo/ShowK_ChartF low.asp?RPT_CAT=PER&STOCK_ID=8473&CHT_CAT=MONTH (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden')))

We can only whitelist sites with an official public API -- if that site has one, could you post a link to the API documentation?

requests.exceptions.ProxyError: HTTPSConnectionPool(host='app.redash.io', port=443): Max retries exceeded with url: /....../api/dashboards?page=1 (Cause d by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden'))) Execution took: 0:00:00 secs (Wall clock time)

Please add this to whitelist

Thanks

Send us a link to the API documentation and we'll consider it for the whitelist.

Hello, can you please add the Roblox APIs, the FunCaptcha API and Discord webhooks?
https://roblox-api.funcaptcha.com (not a public API, but has docs here https://documenter.getpostman.com/view/11276786/SzmZdM3K)
https://discord.com/developers/docs/resources/webhook
https://accountinformation.roblox.com/docs
https://accountsettings.roblox.com/docs
https://adconfiguration.roblox.com/docs
https://api.roblox.com/docs
https://assetdelivery.roblox.com/docs
https://auth.roblox.com/docs
https://avatar.roblox.com/docs
https://badges.roblox.com/docs#!/v1
https://billing.roblox.com/docs
https://captcha.roblox.com/docs
https://catalog.roblox.com/docs#!/v1
https://cdnproviders.roblox.com/docs
https://chat.roblox.com/docs
https://clientsettings.roblox.com/docs
https://contacts.roblox.com/docs
https://contentstore.roblox.com/docs
https://develop.roblox.com/docs
https://discussions.roblox.com/docs
https://economy.roblox.com/docs
https://economycreatorstats.roblox.com/docs
https://engagementpayouts.roblox.com/docs
https://followings.roblox.com/docs
https://friends.roblox.com/docs
https://gameinternationalization.roblox.com/docs
https://gamejoin.roblox.com/docs
https://games.roblox.com/docs
https://groups.roblox.com/docs
https://inventory.roblox.com/docs
https://itemconfiguration.roblox.com/docs
https://locale.roblox.com/docs
https://metrics.roblox.com/docs
https://notifications.roblox.com/docs
https://points.roblox.com/docs
https://premiumfeatures.roblox.com/docs
https://presence.roblox.com/docs
https://privatemessages.roblox.com/docs
https://publish.roblox.com/docs
https://thumbnails.roblox.com/docs
https://thumbnailsresizer.roblox.com/docs
https://trades.roblox.com/docs
https://translationroles.roblox.com/docs
https://translations.roblox.com/docs
https://twostepverification.roblox.com/docs
https://users.roblox.com/docs

The discord API is already on the whitelist and non-public APIs are not eligible for the whitelist. I have added all the documented roblox endpoints to the whitelist.

Hello, Can the incoming webhooks be whitelisted for mattermost? It's being documented here: https://developers.mattermost.com/integrate/incoming-webhooks

Thank you

Incoming webhooks do not need to be whitelisted. The whitelist is for outgoing connections.

Hello, I have a problem sending requests to stooq.com. Is it whitelisted or there is some problem? Thank you

It's not whitelisted. We are happy to whitelist any public, open, documented API. Could you point us to the docs of the endpoint you want to use?

Hey there, can you add the Notion unofficial API to the whitelist? GitHub: https://github.com/jamalex/notion-py

I always get this error and think this will solve it:

requests.exceptions.ProxyError: HTTPSConnectionPool(host='www.notion.so', port=443): Max retries exceeded with url: /api/v3/loadUserContent (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden')))

Thanks in advance!

[edited by admin: formatting]

Hi, unfortunately no, we don't whitelist unofficial APIs.

The thing is, there is no official API from Notion right now and I have a project where I need to fetch data from Notion to create charts from the values and this is the only interface I can use for this. It's a completely public code, I've sent it. It's just unofficial because there is no official one. It would be awesome if you would whitelist it, it's a common tool which many use and it would be very helpful. If not, do you got a recommendation where I can deploy my flask application then? Thanks.

We gladly whitelist any public API which is documented. Free accounts are restricted to the whitelist but paid accounts on PythonAnywhere can access other sites as well.

Hello, could you please add https://dashboard.blomp.com/dashboard/ to whitelist... Thank you

Hello, could you please add https://id-api.spooncast.net to whitelist... Thank you

We gladly whitelist any public API which is documented. Free accounts are restricted to the whitelist but paid accounts on PythonAnywhere can access other sites as well.

Hello, would you be able to add the Horizon API so that I can interact with the Stellar network? Here are the docs: https://developers.stellar.org/api/introduction/response-format/

API: https://horizon.stellar.org/ https://horizon-testnet.stellar.org/

Thank you.

Both of those sites are already on the whitelist.

Hello, would you be able to add the WAVES and PARIBU API so that I can interact with the waves and paribu network? Here are the docs:

https://matcher.waves.exchange

https://www.paribu.com/ticker

Thank you.

Waves is added. For paribu I do not see the docs.

Hello, would you be able to add the ABBSmartSensor and Ubidots API Docs:

api.smartsensor.abb.com/swagger/index.html

&

docs.ubidots.com/reference industrial.api.ubidots.com/api/v2.0/ industrial.api.ubidots.com/api/v1.6/

thx

No problem. I have added those to the whitelist.

would you please add this API to whitelist https://app.swaggerhub.com/apis-docs/I2875/PM25_Open_Data/1.0.0#/Device/get_Device_Latest thank you!

would you please add this API:

https://pm25.lass-net.org/API-1.0.0/

thank you

hi there, going to the site https://pm25.lass-net.org/API-1.0.0/ doesn't show us a documentation page, whereas the previously link does, but it is not on the correct domain name

Could you please add to the whitelist: www.olx.pl

Thank you :)

@nenow79 We gladly whitelist any public API which is documented. Free accounts are restricted to the whitelist but paid accounts on PythonAnywhere can access other sites as well.

page documentation: https://developer.olx.pl/api/doc aditional information

Note: You already accepted to whitelist mirror page: www.olx.ua, therefore hopefully you could accept www.olx.pl as well thank you in advance for your kindly support

Thanks for the link! That's whitelisted now.

Hello, would you be able to add this API to the whitelist: oauth-login.cloud.huawei.com

Documentation: https://developer.huawei.com/consumer/en/doc/development/HMSCore-Guides-V5/open-platform-oauth-0000001053629189-V5#EN-US_TOPIC_0000001063738301__section12493191334711

And this one please : push-api.cloud.huawei.com

Documentation: https://developer.huawei.com/consumer/en/doc/development/HMSCore-Guides-V5/android-topic-based-sending-0000001050040114-V5

No problem, we've added requested endpoints to our whitelist, @icetin.

I appreciate it. @pafk

Hello, can you please add this API to the whitelist: https://brightsky.dev/

Documentation: https://brightsky.dev/docs/#overview--data-origin

Thank you

It looks like the API is hosted at api.brightsky.dev, so we've added that to the whitelist now.

Sorry, my bad. Thank you @giles

Hi guys!

Could you please whitelist this API: https://transparency.entsoe.eu/

Documentation: https://transparency.entsoe.eu/content/static_content/Static%20content/web%20api/Guide.html#_reference_documentation

Thanks in advance

@EMtwitterBot It's done for you

Hi!

Could you whitelist this API (Swedish language parser): https://ws.spraakbanken.gu.se/ws/sparv/v2/

Documentation: https://ws.spraakbanken.gu.se/ws/sparv/v2/api

Many thanks!

Sure, no problem -- that's whitelisted now.

please add https://genius.com/api

We already have api.genius.com on the whitelist. If they also have an API at genius.com, could you send us a link to the part of the API documentation where they mention it?

Hi!!

Could you please add to whitelist

https://coinmarketcap.com https://coinmarketcap.com/exchanges/upbit https://coinmarketcap.com/exchanges/bithumb https://coinmarketcap.com/exchanges/coinone https://coinmarketcap.com/exchanges/korbit

Thank you!!

We already have api.coinmarketcap.com and pro-api.coinmarketcap.com on the whitelist; we only whitelist API addresses, not other pages on websites.

Hi! Could you please add to whitelist https://www.justswap.io/docs/justswap-interfaces_en.pdf https://api.justswap.io/v1/tradepairlist

Sure! That's done now.

Hi could you please add to whitelist

https://talkapi.lgcns.com/request/kakao.json

It's a msg send api for kakao talk, a No.1 dominant messenger app in Korea, and api is provided by LG CNS, a SW focused group of LG.

I got API documentation as an EXCEL file and if you need it I can send it to you.

Thank you !!!

Hi @HaniChang -- could you provide us with official documentation for that endpoint?

Ok @pafk How can I send the EXCEL file I have? Any email address?

The documentation has to be available publicly. It can't be an excel file on your local machine.

@fjl I am not sure if I can find public api documentation for this api... But below are related documentation/website for the api I am using. The main service is Kakao Talk and the very API itself is provided by 3rd party company(LG CNS)

https://t1.kakaocdn.net/kakao_biz_common/prod/cms/donna.k/4c25012c726e4c75bce9f0e2067a47ae?x-content-disposition=inline

https://business.kakao.com/info/bizmessage/

Hope the links above are sufficient... cuz I really need to use this API

Thanx

We need documentation on the site. Generic documentation for software that the site happens to be running is not sufficient.

@glenn Ok then I will ask them if they can provide me with anything like that... If that is not the case, I have to upgrade to paid account right? Paid account can call any API then ? And can you provide me a link that contains the plans of paid account? Thanx!

Yes, a paid account can access the internet without going through the whitelist. The pricing is on your Account page.

@glenn Any paid account, like even 5usd one right?

@HaniChang yes

Can you please whitelist this www.nith.ac.in I am using requests library to fetch college notices for students from my college website.

Send us link to the API documentation for the site and we'll consider it for the whitelist.

Hi there, I was wondering if I could access non-whitelisted URL's but making my site insecure. I am creating a program that check's the URL that the user types and sees what sites it redirects from. The user can type non-whitelisted URL's. Is this possible?

No. Free accounts cannot access non-whitelisted sites.

Hi, I am sorry for taking your time and superb job on prompt support for users!

Is it possible to whitelist this api, I didn't find the documentation. It's simple api that gets excel files for every month in given year that are listed with permanent links.

https://www.theocc.com/api/newlistings/reports?type=options&year=2021

Hi @makythejaki -- could you provide us with API endpoint and official documentation hosted on the same domain?

Hello there

Can you whitelist https://api.covid19tracker.ca please? It tracks COVID-19 in Canada and has public documentation.

Thank you!

@glenn I'm trying to get a Roblox image from its ID, but there isn't a documented way to do that, so I have to do web scraping instead through roblox.com/library/DECAL_ID. However, it's not added to the list, so I there's no way for me to accomplish this. Could you please add roblox.com to the list?

@jdabtieu It's done.

@MmBaguette Send us link to the API documentation for the site and we'll consider it for the whitelist.

Hi there,

Could you please whitelist http://www.waze.com, I need it to get the travel time from two cities :C

Thank you!

@irexfo2 - could you provide us with API endpoint and official documentation hosted on the same domain?

I was using wazeroutecalculator but I cannot find an official documentation, so I switched to openrouteservice library. Here is the documentation https://openrouteservice.org/dev/#/api-docs/introduction. Thank you!

api.openrouteservice.org is already in the whitelist

Could you please add https://rprxy.xyz/ to the list? The documentation is on the site. Thank you!

Sure! That's done now.

Pleas add https://tempmail.plus to white list!

We can whitelist sites if they have an official public API, so please post a link to the documentation if you want us to add something.

Is it possible to add a CDN? assetdelivery.roblox.com, which is in the whitelist, points me to data from c*.rbxcdn.com, and I can't fetch it. Example: https://assetdelivery.roblox.com/v1/assetId/6563894055

Pleas add

https://v3.paribu.com plus to white list!

@supacopy -- all right, we've whitelisted .rbxcdn.com for you.

@alidemir1 -- I've replied you already in a different thread (we need link to an official documentation providing public API enpoints to consider whitelisting a page).

Hi, can you please add:

https://www.nytimes.com/interactive/2020/us/massachusetts-coronavirus-cases.html https://www.nytimes.com/interactive/2020/us/california-coronavirus-cases.html

Thanks!

@aaranguha We can only whitelist a site if it has an official public API. If that site has one, please post a link to the API documentation.

could you put please https://opredelitel.com and https://www.neberitrubku.ru/nomer-telefona/8 to the whitelist? thanks

We can only whitelist sites if they have an official public API, so please post a link to the documentation if you want us to add something.

Could you please whitelist:

www.nike.com

Thanks!

We can only whitelist sites if they have an official public API, so please post a link to the documentation if you want us to add something.

Woocommerce APIs? can it be whitelisted too? http://woocommerce.github.io/woocommerce-rest-api-docs/?python#list-all-product-categories

That appears to be an API that specific other sites would implement; if you want to connect to a specific site that implements the WooCommerce API, we'll need to know what that site is.

can anyone add (RestfulSms.com/api) to whitelist ?

hi, that link does not work for us. Can you give us a link to publicly available documentation?

Hello , I am trying to pull data from Appsflyer ( mobile application tracking system ) but I am getting an error

raise MaxRetryError(_pool, url, error or ResponseError(cause)) urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='hq.appsflyer.com', port=443): Max retries exceeded with url: XYZ (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden')))

API's documentation : https://support.appsflyer.com/hc/en-us/articles/360007530258

best, Mi3t3k

Sure, no problem -- I've added that to the whitelist and it should be active in a few minutes from now.

Hello, I am trying to get data from free API for www.cp.sk. Could you please add this api to whitelist?

Public API's documentation: https://www.inprop.sk/files/products/tt/CP_API.pdf (I found it only in slovak language)

Thanks! danmaj

How to establish credible relation between www.cp.sk domain and docs hosted on www.inprop.sk?

Inprop is the company behind site www.cp.sk . It's one of their products. You can check it also on their web https://inprop.eu/Home/Products/TT - section "Web Solution". I pasted here link for the english version of their website. Unfortunately, I can found API docs only in slovak version.

Hi @danmaj -- documentation you provided doesn't look like a public API. If you want to link to time tables on www.cp.sk from your web app, you don't need to access it.

Hi @pafk

It surely is public. You can translate first header title of documentation from slovak to english. :)

Unless I am (or Google Translate is) misunderstanding that PDF, it appears to be about how to link to the website with tags like this:

<a href="http://www.cp.sk/identifikaciacestovnehoporiadku/spojenie/?f=text&t=text&ch=text&date=dátum&time=čas&direct=true" title="CP - Vyhľadanie spojení v informačnomsystéme cestovných poriadkov.">CP - Vyhľadanie spojení</a>

...which would not require the site to be whitelisted, as you can link to any site you like from your web pages.

Please can you add https://api.spotify.com to whitelist? I am a newbie programmer and getting Tunnel 403 forbidden errors

@jainny, api.spotify.com is already on our whitelist.

I am using a module spotdl to test spotify API. I am getting the following error

spotdl 'The Weeknd - Blinding Lights' --ignore-ffmpeg-version
Searching for song "The Weeknd - Blinding Lights"...
Couldn't read cache at: .cache
Couldn't write token to cache at: .cache
Couldn't read cache at: .cache
Couldn't write token to cache at: .cache
Couldn't read cache at: .cache
Couldn't write token to cache at: .cache
Couldn't read cache at: .cache
Couldn't write token to cache at: .cache
Searching for: The Weeknd - Blinding Lights
HTTPSConnectionPool(host='genius.com', port=443): Max retries exceeded with url: /The-weeknd-blinding-lights-lyrics (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden')))

That looks like the problem is accessing genius.com. Send us link to the API documentation for the site and we'll consider it for the whitelist.

This is the api link https://api.genius.com , the documenation link https://docs.genius.com/

api.genius.com is already on the whitelist, but it looks like your code is going to genius.com, which is not on the whitelist and the documentation does not mention that as a valid API location.

https://pypi.org/project/spotdl/ DOCUMENTATION OF spotdl. Please help me outtt. I don't know much about APIs and what the heck is this genius.com error. Please helpppp

If the library is using the wrong hostname, then the best thing to do would be to suggest to its maintainer to fix that -- we can't whitelist unofficial API hostnames.

Hello team,

could you please whitelist the URL https://www.cricbuzz.com

Thanks in advance.!!

Send us link to the API documentation for the site and we'll consider it for the whitelist.

Hello I am getting same errorHTTPSConnectionPool(host='kilkari-f04c2-default-rtdb.asia-southeast1.firebasedatabase.app', port=443): Max retries exceeded with url: /Data/Filter%20Type.json (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden'))). This api request is from verified firebase development app, to get realtime database from firebase app.

It looks like that has your username in it, so we cannot add it to the whitelist, because it will not be useful too other free users.

There is some sort of error from pythonanywhere's side. MODERATORS PLEASE FIX IT ASAP

What error? What do you want us to fix?

Not only me, even others are facing the below issue for many APIs...

ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden')))

PLZ DO SOMETHING

We have a help page on that: https://help.pythonanywhere.com/pages/403ForbiddenError/

Hi, I have paid account of python anywhere yet I am unable to get request for

"https://cdn-api.co-vin.in/api/v2/appointment/sessions/public/calendarByDistrict", "https://cdn-api.co-vin.in/api/v2/admin/location/districts/" and "https://cdn-api.co-vin.in/api/v2/admin/location/states/"

kindly help me with whitelisting these apis.

All I get is 403!!!!! 13$ all for 403!!!!!!

The whitelist does not affect paid accounts. If you are not running the code in a console that you've created since upgrading, try that. If you're still getting 403s, then they are coming from the site itself and there is nothing that we can do about it. Either you need to authenticate with the site correctly or they are blocking the access. Check the content ofg the 403s - there may be a clue there about how to gain access.

I have fixed the issue and happy to tell you now I can work with a great pythonanywhere setup. The provided apis required geo location specific ips only.

Thank you for your quick and prompt response. :)

Excellent, glad you got it working!

Hi, I have paid account of python anywhere yet I am unable to get request for

"https://cdn-api.co-vin.in/api/v2/appointment/sessions/public/calendarByDistrict", "https://cdn-api.co-vin.in/api/v2/admin/location/districts/" and "https://cdn-api.co-vin.in/api/v2/admin/location/states/"

kindly help me what should I do?

Check what is coming back in the responses you get when you make requests to that site. Because you have a paid account, the requests are going through to it -- hopefully if you look at the responses they are sending back, you'll be able to find out what the problem is.

Hi, can you put the below to whitelist please?

https://scanner.tradingview.com

https://scanner.tradingview.com/crypto/scan

@sajdutt Send us link to the API documentation for the site and we'll consider it for the whitelist.

Hi! Below is the api that calls the of the trading view (https://scanner.tradingview.com/crypto/scan):

https://www.tradingview.com/rest-api-spec/

There is no mention of scanner.tradingview.com on the page at https://www.tradingview.com/rest-api-spec/

Hi Glenn! This is the only ‘api’ I could find as requested by fjl. However, the code repo I am running on your platform is below which generates the 403 error:

https://github.com/CyberPunkMetalHead/Binance-volatility-trading-bot

Actual error from the code repo above upon running:

HTTPSConnectionPool(host='scanner.tradingview.com', port=443): Max retries exceeded with url: /crypto/scan (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden')))

If there is no public documentation that shows that the URL is for use in an API, then it is not a candidate for the whitelist.

Thanks Glenn! Here’s the public usage api:

https://opensourcelibs.com/lib/intellitrader

That site does not look like it is affiliated with tradingview.com. Is there a link on tradingview somewhere that says "here is our API documentation" and links to that site?

hi Glenn, could you add https://firms.modaps.eosdis.nasa.gov/data/ to the whitelist? I'm trying to download csv files from this website using urllib.request.urlretrieve() but encountered "OSError: Tunnel connection failed: 403 Forbidden"

Send us a link to the API documentation for the site and we'll consider it for the whitelist - I just get an error message.

Thanks for your reply. The website where the links can be found is https://firms.modaps.eosdis.nasa.gov/active_fire/#firms-txt

To clarify, the links that I'm trying to access is not to an API. They are links to csv files. Could you consider them for the whitelist?

If there is not API documentation, then we cannot add it to the whitelist.

I see. Thanks for your advice. If I upgrade to paid version, is there access to web links to download files ?

Ye. Paid accounts have direct access to the internet and are not limited by the whitelist.

Hello guys Would you mind whitelisting this link? https://www.notion.so/ here is the link to their API https://developers.notion.com/ many thanks for considering my request.

api.notion.com is already whitelisted and www.notion.so is not mentioned in the docs.

Some commands require access to the notion.so, it's really going to be helpful if whitelisted it. Thank you

if you go to any notion.com/* URL, you'll be redirected to the notion.so the domain.

We're happy to consider notion.so for whitelisting if you provide us with official documentation for that API.

I dont know if that is mentioned in their API, I am a student, and I just use this for practicing, organizing my school work, etc. Would you please tell me how to check for that in the notion's API? This is their API direct link https://developers.notion.com/, how could I check for that. Thank you

It looks like the API endpoint is api.notion.com as @fjl mentioned. I don't see notion.so in the documentation that you provided.

Please can u whitelist the https://kite.zerodha.com domain. I am trying to use this. this is the api document(https://kite.trade/docs/connect/v3/).

api.kite.trade is already whitelisted and it's the only domain mentioned in the docs as far as I see.

Hello team could you please add "https://www.vtu4u.com/results" to whitelist please. I need this for creating rest api. Thanks in advance

Send us a link to the API documentation for the site and we'll consider it for the whitelist.

Can you whitelist the tradestation and twilio api?

https://api.tradestation.com/v2

api.tradestation.com is already on our whitelist.

Good morning, is there a chance that you can add https://www.yahoofinanceapi.com/ to the list? The api provides live financial information.

I don't have any problems when I run the app locally in my computer. However, I am getting the following error:

HTTPSConnectionPool(host='rest.yahoofinanceapi.com', port=443): Max retries exceeded with url: /v6/finance/quote?symbols=AAPL%2CBTC-USD%2CEURUSD%3DX (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden')))

If I was to pay for a membership would I get access to the API?

The relation between yfapi.net and www.yahoofinanceapi.com has to be proven for us to whitelist it.

Hello, Can you add "api.track.toggl.com" to whitelist please?

requests.exceptions.ProxyError: HTTPSConnectionPool(host='api.track.toggl.com', port=443): Max retries exceeded with url: /reports/api/v2/weekly.pdf?user_agent=test%40hotmail.com&workspace_id=3948833&sin ce=2021-10-01&until=2021-10-01 (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden')))

Send us a link to the API documentation and we'll consider it for he whitelist.

Hi, this is the API documentation of "api.track.toggl.com": https://github.com/toggl/toggl_api_docs You have toggl.com on the whitelist but there is no api.track.toogl.com on it. So, they have this message on their oficial documentation:

⚠️ Using the API from toggl.com or www.toggl.com will be dropped at The End of June 2021. Switch to api.track.toggl.com

OK, we've added api.track.toggl.com to the whitelist.

Hi, could you add 'mpk.jacekk.net" and "ttss.krakow.pl" to the whitelist, please?

ttss.krakow.pl is Kraków city public API to get public transport arrivals in real-time.

mpk.jacekk.net is a wrapper over this API (sources are available here https://github.com/jacekkow/mpk-ttss)

We whitelist public APIs which are provide official documentation -- could you send us links to ttss.krakow.pl API docs?

Probably, there is no official documentation for "ttss.krakow.pl". When you need to make a request you just select what you need from UI and then copy the URL.

mpk.jacekk.net has some info on how to use it on https://github.com/jacekkow/mpk-ttss, so you may add only it (it has proxy to ttss.krakow.pl inside)

We need official docs to whitelist.

Hello!

Can you add https://login.wrike.com/ andhttps://www.wrike.com/api/v4/

official docs: https://developers.wrike.com/overview/

it returns 403 proxy err everytime i hit https://login.wrike.com/oauth2/token

Requests.exceptions.ProxyError: HTTPSConnectionPool(host='login.wrike.com', port=443): Max retries exceeded with url: /oauth2/token (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden')))

Thanks!

@agustine It's done for you

hi, can you whitelist http://fiitjeenorthwest.com/time_table.php. Please

Please provide us with official documentation mentioning the API endpoints you want to be whitelisted.

how to find that?

If a service exposes an API there should be a link to documentation or to the API section on their site.

Can you add this one: https://oilprice.com/ ?

@sarabegermy Send us link to official API documentation, please.

Here it is: https://docs.oilpriceapi.com/guide/

No problem. I have added api.oilpriceapi.com to the whitelist.

I cant find the documentation.

If there is no documentation for an API, then we cannot add the site to the whitelist.

Hi PythonAnywhere staff,

Can you add https://docs.predictleads.com/ I purchased an account and I still get Proxy Error OSError('Tunnel connection failed: 403 Forbidden')

On the paid account it should not be a problem. How do you run your code?

I'm using requests.post (built-in module) to make a request to the API that I've linked above. Can you try to whitelist it nevertheless?

Sure, I've whitelisted predictleads.com. But that should not affect your account, as it's a paid one. If it does start working, I recommend that you start a new console to run your code in -- that would imply that you're still running in a console with the old account settings, which would explain why it wasn't working until it was whitelisted.

If it doesn't start working, check the contents of the 403 response you're getting -- it's likely to be a "forbidden" message from the API you're connecting to, rather than something coming from our systems.

I think you got something wrong, since when I tried it now it worked without any additional interference on my side - that's why after you whitelisted the docs. Thanks.

Like I said, I think that's because you were still using a console that you'd started before you upgraded your account -- that would still have the old account settings. So you should start a new console, because otherwise you might still have problems connecting to other non-whitelisted sites.

Hello, is posible, add only one "'https://www.el-tiempo.net/api/". Thank you.

I get a 404 not found error on that page.

Hi PythonAnywhere staff,

Can you add https://coinmarketcap.com/new/ to the whitelist. I tried using requests.get and pandas.read_html to run daily tasks but I keep getting this error:

OSError: Tunnel connection failed: 403 Forbidden urllib.error.URLError: urlopen error Tunnel connection failed: 403 Forbidden

heres the link to the api: https://coinmarketcap.com/api/documentation/v1/#operation/getV1CryptocurrencyListingsLatest The end point I'm interested in is this: https://coinmarketcap.com/new/

According to that documentation, the coinmarketcap API is on pro-api.coinmarketcap.com and sandbox-api.coinmarketcap.com, so I have added those to the whitelist. https://coinmarketcap.com/new/ is not an API endpoint.

Got it. One more question. If I upgraded my account, would I be able to run daily tasks on https://coinmarketcap.com/new/ ? even as it is not an API endpoint

Yes, you would.

Hello, Can you add https://ethgas.watch/api/gas to the whitelist.

@trabelssi38 -- provide us with the official documentation for this API endpoint and we'll consider it for whitelisting.

Here it is: https://docs.ethgas.watch/

No problem. I have added that to the whitelist.

Hi you can add this api -> https://www.dolarsi.com/api/api.php?type=valoresprincipales' i need this service for a project:Than you

@marcosriarte Please provide us with official documentation mentioning the API endpoints you want to be whitelisted.

Would it be possible to add the Pixela API? The documentation is here: https://docs.pixe.la/

No problem. I have added pixe.la to the whitelist.

Hello! Can you add it to whitelist? https://github.com/shvetsantonyx/Django-blog.git

github is already whitelisted.

can you please add www.hindilinks4u.to to wishlist

@YesItsAnotherAccount -- provide us with official API documentation with the endpoints you want to be whitelisted and we'll consider them for our list.

Can you please add https://sunnah.com/ in whitelist.

@abdulmuizz0903 -- provide us with official API documentation with the endpoints you want to be whitelisted and we'll consider them for our list.

API documentation of sunnah.com https://sunnah.api-docs.io/1.0/getting-started/introduction I want the whole website to be whitelisted.

is there a link from sunnah.com to sunnah.api-docs.io?