Forums

requests.exceptions.ProxyError: HTTPSConnectionPool(host='spotifycharts.com', port=443): Max retries exceeded with url: /regional/in/daily/latest/download (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden'))

Hi, I have developed a Twitter bot that scraps charts data from spotifycharts.com Bot : https://twitter.com/kcharts_india

but seems like scrapping data has been restricted from the server I have been given to use. Running from a personal laptop works as I am able to scrap and push data. The bot has been made after being reviewed by the Twitter community to not be counted as spam. Can I know what procedure should I follow from server should to have this whitelisted ?

As I see another user's website needed to be whitelisted, https://www.pythonanywhere.com/forums/topic/12714/

Free accounts can only access sites on our whitelist. If the site has a publicly documented API, send us a link to the API documentation and we'll consider it for the whitelist.

I see.... site doesnt have any API way to access its information...data needs to be scrapped from their csv download

[formatted by admin]

ProxyError at /offender/dashboard
HTTPSConnectionPool(host='webapps.doc.state.nc.us', port=443): Max retries exceeded with url: /opi/offendersearch.do?method=list&searchLastName=patel&searchFirstName=&searchMiddleName=&searchOffenderId=&searchGender=&searchRace=&searchDOB=&searchDOBRange=&ethnicity=&ageMinimum=&ageMaximum=&page=1 (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden')))

Please whitelist my url Here is url data policy : https://webapps.doc.state.nc.us/opi/privacy.do

Hi @jay88320 -- that doesn't look like a public API. We don't whitelist domains for scraping. Could you provide us with a public API endpoints for that domain?

Hello Sir/Mam, I request you to please whitelist my API URL. The error seems as follows- HTTPSConnectionPool(host='restapismtp.herokuapp.com', port=443) Thank You!

We need a link to the official current docs mentioning the endpoint you want us to whitelist.

can you whitelist this url "https://www.interviewbit.com" please @PythonAnywhere

@architjain128 If the site has a publicly documented API, send us a link to the API documentation and we'll consider it for the whitelist.

can you whitelist this url "https://www.dictionary.com/" please @PythonAnywhere

Send us a link to the API documentation and we'll consider it for the whitelist.

Please can you whitelist this api for me? I'm making a simple daily cat pic mail out using: https://api.thecatapi.com/v1/images/search

Hope you can help, the world needs more cat pics.

Send us a link to the API documentation and we'll consider it for the whitelist.

Thanks very much!

The Cat API: Docs

That appears to already be on the whitelist.

Thanks Glen, my bad, must be an error in my code. Sorry to waste your time!

*Glenn

can you whitelist this url "https://www.islom.uz/" please @PythonAnywhere

Send us official API documentation for that site and we'll see what we can do.

Hi can you whitelist this url "www.cnbc.com"

I found the API provided on rapidapi.com. Is it possible to use that one?

API: https://rapidapi.com/apidojo/api/cnbc API docs: https://docs.rapidapi.com

@aditianand Could you give a link to the page in the docs where the domain is mentioned?

Hi fjl @PythonAnywhere. In the quick start guide on rapid api's docs page, (https://docs.rapidapi.com/docs/consumer-quick-start-guide#api-listing-overview), they mention that the individual documentation for each api is mentioned on Endpoints tab in the API's listing page itself.

So this would be the middle section on the page of the API link that I sent before (copied here again: https://rapidapi.com/apidojo/api/cnbc). For reference, I've included the link to the example image they showed on the guide page (https://files.readme.io/dd503b3-translate.png). Hope this helps.

No problem. I have added cnbc.p.rapidapi.com to the whitelist.

Thank you

Can you please add https://api.kanye.rest/ to you whitelist @pythonanywhere

Send us a link to the API documentation and we'll consider it for the whitelist.

http://simistocks.com/ please whitelist this api

http://simistocks.com/ please whitelist this api

We can only whitelist a site if it has an official public API. If that site has one, please post a link to the API documentation.

Hi could you please whitelist the following link:storefront-prod.nl.picnicinternational.com The link to the docs: https://github.com/MikeBrink/python-picnic-api Thankyou!

@ JonathanvanDiermen Thank you for your request, we will require official api documentation on the picnicinternational.com. The documentation link which was sent is an unofficial library that uses the api.

To the Pythonanywhere I would like to request add below link as whitelist as its API documentation is publicly available.

API Reference: https://filestack-python.readthedocs.io/en/latest/api_reference.html

Python SDK: https://github.com/filestack/filestack-python

Full Documentation: https://www.filestack.com/docs/

@hemayat Hi, www.filestackapi.com has been added to the whitelist.

https://justanotherpanel.com/api

@hmalik Hi, thanks for addition but i still get the below error while running my app:

requests.exceptions.ProxyError: HTTPSConnectionPool(host='upload.filestackapi.com', port=443): Max retries exceeded with url: /multipart/start (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden')))

i dont know if this is the correct form you added filestackapi.com for this website filestack.com or maybe there is another problem although as i checked your whitelist in link below filestack.com was not added there. https://www.pythonanywhere.com/whitelist/

kindly check the issue and thanks for the feedback

@hemayat Hi, We have taken a look at the above message, you are hitting upload.filestackapi.com and we have whitelisted www.filestackapi.com. If you would like us to whitelist upload.filestackapi.com, please send us the API documentation which lists this api endpoint.

@hmalik Hi & Thank you for responding by soonest,

this is the endpoint to be whitelisted https://cdn.filestackcontent.com/

Hi, kindly can you whitelist pipedream.com. Regards

@hemayat -- we need to see some documentation on the filestackcontent that mentions that hostname.

@Alevaroz -- Send us a link to the API documentation and we'll consider it for the whitelist.

@giles it's been third time I'm sharing full detail and docs once again here it is the reference for api to the endpoint https://cdn.filestackcontent.com/ which mentioned the above host name you can find out in the link below.

https://www.filestack.com/docs/delivery/cdn/

@hemayat -- thanks for sharing the right page in the docs, I've whitelisted cdn.filestackcontent.com now. For future reference -- we need the URL for the actual page containing the hostname that you would like to have whitelisted.

Hi could you please whitelist the following link: API documentation - https://docs.mail.tm/

Sure! I've added api.mail.tm to the whitelist and it will be active within about five minutes.

Hello! Can you add please https://wax.atomichub.io/ to whitelist? Here is API documentation: https://wax.api.atomicassets.io/docs/#/

@KraKoff Hi, If you would like us to whitelist https://wax.atomichub.io/, please send us the API documentation which lists this api endpoint. The documentation sent does not detail the endpoint.

@hmalik https://github.com/worldwide-asset-exchange/atomicassets-api#namespace-api-endpoints is that what you are asking me?

Hi could you please whitelist https://athcoinindex.com/coin/binancecoin ?

Thank you and also I would also love to know if someone has a paid account will pythonanywhere algoritm stop asking for whitelisting of websites?

Your response will be highly appreciated mail: muhammed15211000@gmail.com

@developermo Hi, If you would like us to whitelist https://athcoinindex.com/coin/binancecoin, please send us the API documentation which lists the api endpoint. Please note we can only whitelist sites with an official public API.

Please see the url below for additional information: https://help.pythonanywhere.com/pages/RequestingWhitelistAdditions/

Hi could you please whitelist the following link: https://ocr.asprise.com/api/v1/receipt The API Document is here - https://asprise.com/ocr/api/docs/html/receipt-ocr.html Thanks!

Can you whitelist api.wasteof.money? The docs are here: https://oren-lindsey.github.io/wasteof2-docs-pages/posts

@nonbiasedorg In regards to your request to whitelist the above endpoint, please note we need public documentation stating the hostname for the endpoint. We are not able to whitelist the domain based on the provided information.

@RunCode ocr.asprise.com has been added to the whitelist.

Please add this to whitelist..

https://github.com/algo2t/alphatrade

got error: Traceback (most recent call last): File "/home/amiya000/TheScalper/Testing.py", line 7, in <module> sas = AlphaTrade(login_id=login_id, password=password, twofa=twofa) File "/home/amiya000/.local/lib/python3.10/site-packages/alphatrade/alphatrade.py", line 238, in init if not self.__is_token_valid(): File "/home/amiya000/.local/lib/python3.10/site-packages/alphatrade/alphatrade.py", line 278, in __is_token_valid resp = self.reqsession.get(profile_url, headers=self.__headers) File "/usr/local/lib/python3.10/site-packages/requests/sessions.py", line 600, in get return self.request("GET", url, kwargs) File "/usr/local/lib/python3.10/site-packages/requests/sessions.py", line 587, in request resp = self.send(prep, send_kwargs) File "/usr/local/lib/python3.10/site-packages/requests/sessions.py", line 701, in send r = adapter.send(request, **kwargs) File "/usr/local/lib/python3.10/site-packages/requests/adapters.py", line 559, in send raise ProxyError(e, request=request) requests.exceptions.ProxyError: HTTPSConnectionPool(host='alpha.sasonline.in', port=443): Max retries exceeded with url: /api/v2/profile (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel conne ction failed: 403 Forbidden')))

Hi, I have the same error stated like above. Is my api ok? Can you check? https://api.npoint.io/430bc502f1f18c701262 I created json storage bin from https://www.npoint.io/ Is my error problem caused by it is not in the whitelist?

@amiya000 In regards to your request above, please note we need public documentation stating the hostname for the endpoint you would like us to consider. We are not able to whitelist the domain based on the provided information, as it is unofficial documentation.

@novimuse If you would like a domain to be considered for the whitelist , please send us a link to the API documentation. Please note we can only whitelist sites with an official public API.

I requests all subdomains of wasteof.money to be unblocked. The creator says he is fine with it being used on PythonAnywhere. You can see him saying it here: https://beta.wasteof.money/users/jeffalo/wall/633ca0288b29a1398d608379. Not sure if this counts, but the docs I gave previously were the only ones that exist. wasteof.money is a social media.

That is not public API documentation. Without public API documentation, we cannot add it to the whitelist.

Hello guys and girls of "pythonanywhere.com" team!

Pleas add to your "white list" this API : https://github.com/flyingrub/scdl

The API based on this documentation : https://developers.soundcloud.com/docs/api/guide

Best regards, Ivan

Hi pythonanywhere.com team, could you please whitelist this url for me - https://coji-code.com/?

Here is the github link for my API: https://github.com/maxfyk/coji-api.

To The PA Team,

Hello and thanks for the service i had an issue regarding my app weeks ago and i requested to whitelist some domains and you did thank you, but still my app is not working and i figured out that one other domain needs to be whitelisted.

below sites are already whitelisted : cdn.filestackcontent.com www.filestackapi.com

the endpoint which cause error is this (upload.filestackapi.com) which is subdomain of above site so kindly whitelist this endpoint for me. Thank You so much

Note: as i checked the public documentation of the related sites i did not find this endpoint there though i cant share the exact page related to this endpoint but this is the endpoint which cause the error in my app and i am using the same website service not any other, i am using python SDK of that site maybe they forgot to write about this endpoint.

Public Docs & API reference: https://www.filestack.com/docs/ https://filestack-python.readthedocs.io/en/latest/

looking forward to your reply, BR

@ivanilla Hi, can you please confirm which endpoint you would like us to consider adding to the whitelist? Please note we can only whitelist sites with an official public API.

@maxfyk Please note we are unable to view the link which has been sent. Please note we can only whitelist sites with an official public API. Please also see the url below for additional information: https://help.pythonanywhere.com/pages/RequestingWhitelistAdditions/

@hemayat Thank you for your message. We would only be able to consider the requested endpoint, if you are able to send us us a link to the API documentation which documents the endpoint. Otherwise we are not able to add the requested endpoint to the whitelist.

requests.exceptions.ProxyError: HTTPSConnectionPool(host='backend.craiyon.com', port=443): Max retries exceeded with url: /generate (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden')))

https://huggingface.co/dalle-mini/dalle-mini

https://huggingface.co/docs/api-inference/index

.

https://huggingface.co/spaces/dalle-mini/dalle-mini

the above one is being migrated to

https://www.craiyon.com/

@ElonNLP If you would like the above domain to be considered for the whitelist , please send us a link to the API documentation. Please note we need public documentation stating the hostname for the endpoint.

@Pythonanywhere Could you please whitelist the two open source licenses texts urls: https://opensource.org/licenses https://spdx.org/licenses Thank you

@hmalik Dear,

Thanks for rapid supporting all the time. related to my last request with you I contacted the support team of the company which I use their API they found and added the endpoint.

kindly whitelist below endpoint: upload.filestackapi.com

Documentation: https://filestack.github.io/filestack-js/globals.html#config

@Sihem -- we can only whitelist public APIs. If that site has one, please provide a line to the API documentation.

@hemayat -- a colleague is looking into this and will be in touch shortly.

Please white list below api since i am getting the error and not able to proceed with my application. API - apix.stocksdeveloper.in

Error - raise ProxyError(e, request=request) requests.exceptions.ProxyError: HTTPSConnectionPool(host='apix.stocksdeveloper.in', port=443): Max retries exceeded with url: /trading/placeRegularOrder (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden')))

Official Website - https://stocksdeveloper.in/

@edwindgr8 - this site has been added: apix.stocksdeveloper.in

@giles dear support team,

what's update? on this: @hemayat -- a colleague is looking into this and will be in touch shortly.

@hemayat - sorry for the delay, upload.filestackapi.com has been added to the whitelist.

hi can you add tradingview in whitelist, i really want it please docs: https://python-tradingview-ta.readthedocs.io/en/latest/ ---- https://pypi.org/project/tradingview-ta/ ----- https://tvdb.brianthe.dev/

@aminsharif Hi, Thank you for your message. Can you please confirm the endpoint which you are requesting we consider for the whitelist? Please also note we need public documentation stating the hostname for the endpoint, we are not able to whitelist the domain based on the provided information.

@PythonAnywhere Thank you for your feedback, here in below I have mentioned the links regarding the Tradingview.com website. This is a REST API for brokers. The version of this API is 1.3.30. Could you please confirm if the information I have provided is covering your questions.

https://www.tradingview.com/rest-api-spec/

@aminsharif Thank you for sending the above documentation url. But please note we are not able to whitelist the domain, as in the documentation the domain given is just an example: https://your-rest-implementation.com.

I would appreciate it if you could add the website https://www.call2all.co.il The link to the documents is https://docs.google.com/document/d/1ln2j0Nhe0VO4Rt6fFquaXziSq-IIr9I_SE_R35WXe-k/mobilebasic#:~:text=https%3A//www.call2all.co.il/ym/api/%3CWebServiceName%3E%5B%3Fp1%3Dv1%5B%26p2%3Dv2...%5D%5D

and the website https://www.hamichlol.org.il https://en.wikipedia.org/api/rest_v1/ This is a wiki as you can see https://www.hamichlol.org.il/w/api.php?format=json&action=query&prop=extracts&exintro&explaintext&redirects=1&titles=Stack%20Overflow

@yemot In regards to both your requests, if the links sent are the official documentations can you please send us direct links from the actual websites linking us to those documentations? Please note we can only whitelist sites with an official public API.

Regarding the first, these are the official documents And the second is a Wikipedia page On both sites you can see the word API in the URL https://call2all.co.il/ym/api/GetIncomingCalls

This link https://www.call2all.co.il/f2 of the same domain Refers to the website https://freeivr.co.il/oldforum and the new domain has https://f2.freeivr.co.il/post/75

'https://docs.zenoti.com/reference/list-all-centers' this API doc , I am getting the error of max retries exceeded..... while using zenoti , please whitelist this API. I am hitting this two API : 1) https://api.zenoti.com/v1/centers 2) https://api.zenoti.com/v1/centers/center_id/employees

@yemot Thank you for your reply. Please note this url is not a link to the official documentation and i am unable to view the documentation: https://call2all.co.il/ym/api/GetIncomingCalls , and the previous link also states that the document is a draft. Please note the second link https://www.call2all.co.il/f2 does not seem to be working.

If you would still like us to consider your request, please send us a direct link to the domain you wish for us to consider and also send us documentation directly on the domain or please send us direct links from the actual websites linking us to those documentations.