Forums

Proxy error when using requests in Pythonanywhere

Hi there, I'm using requests library (through Soundcloud module) and I'm having an error:

Caused by ProxyError('Cannot connect to proxy.', error('Tunnel connection failed: 403 Forbidden' when I try to access soundcloud API.

The strange thing was that in interactive mode I was able to connect it successfully with the API, but when I run my app it fails.

Best

That is very strange. Are the interactive mode and the web app definitely using the same API domain for soundcloud?

Disregard the interactive thing, entirely my fault. Just learned that the API endpoint that caused the failure was not the one I was testing in interactive mode.

The API endpoint that caused it is called /oembed (https://developers.soundcloud.com/docs/oembed) and its URL is:

http://soundcloud.com/oembed

I see in PythonAnywhere whitelist api.soundcloud.com but not soundcloud.com/oembed

Is it possible to white list this URL (since it is part of the Soundcloud API)?

Best piqoni

No problem. Try it now?

You guys rock!

It works.

Thanks

sorry for the trouble but could you please add nus.edu.sg on the whitelist because it is used for authentication BTW, i saw ntu on the list.....

If there's an official public API there, we can whitelist it -- just give us a link to the API docs.

https://wiki.nus.edu.sg/display/ivlelapi/Summary

https://wiki.nus.edu.sg/display/ivlelapi/Getting+Started

From that, it looks like ivle.nus.edu.sg is the correct API endpoint. Does that sound right to you?

yes
thanks

may i check when will it be added to the whiteliest. best regards

Would it be possible to add waterlevel.ie/data/ ? I'm trying to generate some graphs for our university kayak club webpage, link to the api docs: https://waterlevel.ie/page/api/

Both of those are whitelisted now.

Could you please whitelist https://api.darksky.net/forecast/ API and ip-api.com/json. I'm using it for rain prediction. Docs link: https://darksky.net/dev/docs

OK, have added those two. let us know if it works oK?

They work fantastically! Thanks!

Could you please whitelist script.googleusercontent.com ? I'm using pythonanywhere with google apps script web app.

ok. I looked into the documentation and I believe script.googleusercontent.com is used when google apps script returns content after you hit script.google.com, and is used as a one-time url.

I've whitelisted script.googleusercontent.com for you.

Thank you so much!!

Hi PythonAnywhere friends!

I am getting a proxy error on a simple subscribe request to the mailchimp api. Is it possible to get this whitelisted?

The endpoint im hitting looks like this: https://us14.api.mailchimp.com/3.0/lists/xxxxxxxxx/members/

Thanks so much and blue skies!

Hi there, I've added *.api.mailchimp.com to the whitelist now, let us know if it works OK!

Hi can anybody help to add api.hunterexpress.com.au into whitelist?

Thanks

I couldn't find any api docs there. Could you send a link to the api docs?

Hi Glenn here is API doc: http://staging.hunterexpress.com.au/apidocs/

Thanks

No problem. I've added both the live and the testing domains to the whitelist.

Work like a charm, thanks Glenn!

Hi guys, can you please white list https://app.asana.com/api ?

Thanks!

okay, we have whitelisted app.asana.com for you!

Hello guys, I see that you have added https://api.darksky.net/forecast/ API to the whitelist can you also please add 'https://darksky.net/details/' as well. I'm using it to get historical weather data.

Thanks.

Hi there, that second url looks designed for human consumption, not machine consumption, so that tends to rule it out from being added to the whitelist I'm afraid.

paid accounts start from just $5 tho!

Hello, Sir, I want to access KiiCloud for a datastore, could you please add it to whitelist? English Doc: https://en.kii.com API: https://api-jp.kii.com

Ok. I've added that to the whitelist.

Hello, Sir, thanks for your quick response. However, when I access the service via KiiCloud SDK, the error "urllib2.URLError: <urlopen error Tunnel connection failed: 403 Forbidden>" remains. (The url is https://api-jp.kii.com/api/oauth2/token) I also restarted the bash console. May you help me ?

Ah. Sorry about that - I didn't finish the process properly. It's working now.

Thanks, it worked.

Hello, Sir, After you set https://api-jp.kii.com into your whitelist, it worked well. But it suddenly does not work now. The request worked well these day, but now it took a very long time, and failed. Is there anything wrong with it? FYI, no problem for accessing the same KiiCloud from my local or from Google.

It seems proxy server is down.

Oh, now it works : )

Doesn't seem to work for me, I get the ProxyError all morning :(

Could you check again now? We just restarted it.

It works now, thank you!

Excellent, thanks for confirming!

It's working now. Thanks.

Thanks for confirming!

Hai, can you whitelist https://xtremetricks.net/ this link? im using it and im getting error('Tunnel connection failed: 403 Forbidden'). Please help

Send us a link to the API documentation and we'll consider it.

Give me your email id or something

please i need it... i use that website to collect information using my python script

Do they have API docs? Where are they?

No it is just a website

Unfortunately we can only whitelist sites with an official public API.

Hi, Sir, Do you have https://www.twilio.com in your whitelist?

FYI: https://www.twilio.com/docs/

yes. the full whitelist is here: https://www.pythonanywhere.com/whitelist/

Hi, Sir Can you add api.twilio.com to your white list? It seems twilio has changed its api server.

If .twilio.com is enough, I am sorry. I will check again the error log and my code.

let us know how you get on!

Hi there. I also get the ProxyError message. Could you please also whitelist the following api: host='api.opentransportdata.swiss'

Thank you for your help!

can do! can you send us a link to the api documentation?

more information re; requesting whitelist additions is available here, everyone:

http://help.pythonanywhere.com/pages/RequestingWhitelistAdditions/

Thank you for your reply. You can find the API documentation here: https://opentransportdata.swiss/en/dataset/fahrtprognose

Unfortunately, it's mostly in German. But the API is nothing else than train timetables etc. for the Swiss public transport system.

OK, have added that now, let us know if it works OK?

It works perfectly fine, thank you very much for your help!

Excellent, thanks for confirming!

Hi again. I got another tunnel error and kindly ask you to whitelist the following API: https://data.sbb.ch/api/records/1.0/search/?

The documentation can be accessed here: https://data.sbb.ch/explore/dataset/actual-data-sbb-previous-day/information/?timezone=Europe%2FZurich&refine.bpuic=8503011

Again, the API is for public transport information (a different one this time).

Thank you for your help!

Hi there, I've added that to the whitelist now, let us know if it works?

It works now, thank you so much!

:)

Can I request for Globe Labs API to be added to the whitelist too? Thank you very much!

API endpoint I'm accessing: https://developer.globelabs.com.ph/oauth/access_token

API Docs: http://www.globelabs.com.ph/docs/

Hello,Sir Here are several APIs of bitcoin exchanges in Japan.

Coincheck:

API:https://coincheck.com

DOC:https://coincheck.com/ja/documents/exchange/api

Bitflyer:

API:https://api.bitflyer.jp/v1/

DOC:https://bitflyer.jp/ja-jp/api

Bitbank:

API:https://public.bitbank.cc

        https://api.bitbank.cc/v1

DOC:https://docs.bitbank.cc

Zaif:

API:https://api.zaif.jp/tapi

DOC:https://corp.zaif.jp/api-docs/

Would you please add them in white list?

Thanks very much.

Regards

Those docs only refer to devapi.globelabs.com.ph, so I have whitelisted that.

Hello,

If you go to the "Opt-in via webform" section (http://www.globelabs.com.ph/docs/#getting-started-opt-in-via-webform), you'll see the endpoint I need (https://developer.globelabs.com.ph/oauth/access_token) in item number 6. Please whitelist that, thank you very much! :)

Ok. I see that. I have whitelisted the extra domain.

Alright, thank you!

No problem, glad to help!

can we get http://nodes.wavesnodes.com/api-docs/index.html whitelisted? port 443

i believe this is why i am getting the proxy error?

Sure! That's whitelisted now.

Can you please whitelist "https://www.pdfzorro.com/" API Docs here "https://www.pdfzorro.com/EDIT/api_anleitung.php" I am getting error accessing "https://edit.pdfzorro.com/pdf/**/***.pdf" Thank you in advance.

No problem, I've whitelisted www.pdfzorro.com. That won't cover edit.pdfzorro.com, though -- is there documentation that mentions that hostname?

Hello,Sir Here are several APIs of bitcoin exchanges in Japan.

Coincheck:

API:https://coincheck.com

DOC:https://coincheck.com/ja/documents/exchange/api

Bitflyer:

API:https://api.bitflyer.jp/v1/

DOC:https://bitflyer.jp/ja-jp/api

Bitbank:

API:https://public.bitbank.cc

    https://api.bitbank.cc/v1

DOC:https://docs.bitbank.cc

Zaif:

API:https://api.zaif.jp/tapi

DOC:https://corp.zaif.jp/api-docs/

Would you please add them in white list?

Thanks very much.

Regards

Sure! Those are whitelisted now.

Hello Sir, I want to use an API but I am getting error Tunnel Connection Failed.

API: https://api.stride.ai/doc_sentiment.json

API DOCS: https://stride.docs.apiary.io/#reference

Will you please add stride API to whitelist ?

Thank you very much.

no problem, have added that now, let us know if it works OK?

Hello . Can you whitelist "https://api.lendix.com" Thanks

Hi there, can you show us the api docs for api.lendix.com? Thanks

https://lendix.com/cgu-lendix-fr/

DOC "https://lendix.com/cgu-lendix-fr/"

Hmm, that page seems to be more a general terms and conditions page -- it mentioned api.lendix.com, but I can't see any documentation relating to the API specifically. Is there something that documents how to use the API?

Hi can you please whitelist "api.huobi.pro" ? this is a cryptocurrency exchange huobi.pro

Hello! could you whitelist "https://webapps2.abc.utah.gov/Production/OnlinePriceList/DisplayPriceList.aspx" please?! It is a public site from the state of Utah.

Edit: posted twice

@prateekjjw001, @JesseScraper -- could you give us links to the API documentation for those sites, please?

https://github.com/huobiapi/API_Docs_en/wiki/Huobi.pro-API there is github code and documentation. https://github.com/huobiapi/REST-API-demos

@prateekjjw001 what we need is a page on huobi.pro that says "our official API is at api.huobi.pro", or something like that.

@giles No API documentation available.

@giles No API documentation available.

Unfortunately, there is no such thing on their site. Only github api documentation is available

Then the site is not a candidate for inclusion in the whitelist.

Hi there, Could you please whitelist https://www.babelio.com/auteur/Frederic-Dard/7187/citations . I'm using this link in my Mooc to learning Python. Thank you so much.

Hi there -- could you give us a link to the API documentation that says it's OK to programmatically access that page?

Hi again, how can I get that?

If that site allows programs to scrape it, they'll say somewhere on the site.

Hello . Can you whitelist "https://api.elasticemail.com/v2/" Thanks

Hi, can you whitelist "https://playoverwatch.com" I did a simple scraper but i get the proxy error

Thanks

@ayevan and @Careerow, please post a link to the API documentation that shows the domain that the API is published on.

@glenn Unfortunately there are no API available for Overwatch, so I made a scraper of the "career" page The Url of the request is: https://playoverwatch.com/en-us/career/pc/battletag-1234

Unfortunately we can't whitelist sites without an official public API.

could you please whitelist https://weatherbit.io ?

API DOCS: https://www.weatherbit.io/api

Thanks!

Ok. I have added that to the whitelist.

Could you also please whitelist https://www.medanswering.com/Provider_API.taf? for me? API documentation here: https://www.medanswering.com/documents/Doc-MAS_Public_Site--2017-05-16-15-09-59.pdf

Thank you!

Ok. I have added that to the whitelist.

Awesome!

Can you whitelist textgain (https://api.textgain.com/), perhaps? Docs are here: https://www.textgain.com/api

Ok. I have added that to the whitelist.

@glenn

Can you add *.dol.gov ?

My app download few pdfs from efast.dol.gov (United States DEPARTMENT OF LABOR)

Could you give us a link to some kind of docs saying that automated access to the site is OK?

Also -- you have a paid account, so the whitelist won't affect outbound Internet access from your app -- is the one you're talking about running in a different, free account? If not, the problem won't be fixed by whitelisting the site.

Hi, I'm getting this same error for the endpoint https://hourlypricing.comed.com/api, docs at https://hourlypricing.comed.com/hp-api/

Ok. I have added hourlypricing.comed.com to the whitelist.

Hello, Sir, I want to access subscenes for getting movie subtitles, could you please add it to whitelist? English Doc: https://subscene.com API:sathya1124.pythonanywhere.com The sathya1124.pythonanywhere.com is working but when i type the movie name and click search it is producing forbidden error 403..

Could you give us a link to the official API documentation? This needs to be a page on the domain subscene.com that describes their API and how to connect to it.

this is not an offical api..i took that from github.. https://github.com/mamins1376/Subscene-API

If it's not an official API, unfortunately we can't whitelist it.

Hello, could you please add to whitelist the following API: Getbible (http://getbible.net/) API and Info (using JSON): https://getbible.net/api WEBSITE: https://getbible.net/about Thank you!

Ok. That's done.

Hello,could you add "adafruit.io" cloud api's in the whitelist

Best regards

endpoint is "https://io.adafruit.com/api/v2/giripranay/feeds/bin1/data?X-AIO-Key=a68f2ef379d4470780176f536af0f462"

Please provide a link to the official API documentation describing the endpoint that you are proposing to whitelist.

Wow, did not expect such a fast response. Link for API documentation:

https://io.adafruit.com/api/docs/#section/Authentication

Website : https://io.adafruit.com/

I am sending sensor data to adafruit cloud .When i want to retrieve my sensor data,i run a https request using API key provided by them.It worked well when i used it locally(using django on my PC).Now i want to host my website on pythonanywhere.It shows error when I run https request on pythonanywhere.

Best regards,

Thanks! That's whitelisted now.

Thanks a lot...!It's working now.

Excellent, thanks for confirming!

Hello, could you add a service 'pogoda.mail.ru' to the white list? End point https://pogoda.mail.ru/ Official documentation https://api.mail.ru/docs/

Hello, I create a bot for a social network that could send up-to-date weather data. For hosting decided to choose pythonanywhere. But I encountered an Proxy error. Could you add a service 'pogoda.mail.ru' to the white list? End point https://pogoda.mail.ru/ . Official documentation https://api.mail.ru/docs/. Best wishes.

it seems like their api is at www.appsmail.ru/platform/api, and not at pogoda.mail.ru, so we cannot whitelist that.

Thanks for the info and help.

Hi there, I am trying make a storage solution for my django application. Their main website is https://gofile.io and all the api calls are done using https://api.gofile.io/ Please whitelist them. Thank you.

Could you give us a link to documentation on the gofile.io site saying that automated access to the site is OK, and listing the api endpoints?

Can you whitelist https://in.bookmyshow.com?

Could you give us a link to the official API documentation? This needs to be a page on the domain bookmyshow.com that describes their API and how to connect to it.

Can you also add https://www.thestar.com.my/news/ to the whitelist? Im just scraping the website to gain data on news. Mainly for educational purpose?

If they have a publicly documented API, send us a link to the documentation and we'll consider it for the whitelist. If they do not have a publicly documented API, then it's not a candidate for the whitelist.

Can you please add http://app.neaea.gov.et/Home/result10 to whitelist? I'm trying to fetch student results from it but I can't connect since it is in blacklist.

Could you give us a link to the official API documentation? This needs to be a page on the domain app.neaea.gov.et that describes their API and how to connect to it.

.

Hello, your whitelist has the url WolframAlpha API (api.wolframalpha.com), but I can't download pictures from WolframAlpha because they have a different url: www4c.wolframalpha.com, www5b.wolframalpha.com, www5a.wolframalpha.com. (maybe there are others)

Official wolframalpha API documentation: https://products.wolframalpha.com/simple-api/documentation/

If you can provide a list of the image domains that are used, we can add them for you. Otherwise, we'll just spend ages adding one domain after another and waiting for a new one to appear.

I wrote in the previous post the domains I saw. Unfortunately, I'm not sure if this is a complete list, but I haven't come across any other domains.

I know of domains: www4c.wolframalpha.com, www5b.wolframalpha.com, www5a.wolframalpha.com.

We need public documentation for the URLs.

Is it possible to add to white list mafiaonline.ru ? It got public API (https://blog.mafiaonline.ru/api/), but its in russian...

On the API docs, I see a st.mafiaonline.ru, and a mafiaweb.ru. Can you confirm if there is anything else, or if those two would work?

Hello. I use the Yandex Disk API, but its url is not in the white list. Please add them. I use the REST API, its domain: https://cloud-api.yandex.net/ All url requests can be found on the polygon: https://yandex.ru/dev/disk/poligon/#!/%20/%20v1/disk/resources

Official documentation: https://yandex.ru/dev/disk/api/concepts/about-docpage/

No problem. I have added that to the whitelist.

Thanks

But I still get a connection error. What should I do?

Error: HTTPSConnectionPool(host='cloud-api.yandex.net', port=443): Max retries exceeded with url: /v1/disk/resources?path=temporar y_file&permanently=false&force_async=false (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7fcfac954d68>: Failed to estab lish a new connection: [Errno 101] Network is unreachable'))

You probably need to configure your code to use the proxy. See http://help.pythonanywhere.com/pages/403ForbiddenError/

Everything works on my home computer. Maybe you need to add all the domains provided in the documentation ?

All URLs are on the polygon: https://yandex.ru/dev/disk/poligon/#!/ / v1/disk/resources (each one starts with: https://cloud-api.yandex.net)

On your local machine, you are not using the proxy. See the link Glenn posted above.

All the subdomains of

.yandex.com
.yandex.net
.yandex.ru
.yandexcloud.net

are whitelisted

Can you whitelist https://www.manoramaonline.com and https://indianexpress.com/

We only whitelist sites with public api documentation.

Hi, coud you please whitelist https://api-covid19.rnbo.gov.ua/ ? This API currently doesn't have public documentation, but it's used by our official COVID info website https://covid19.rnbo.gov.ua/

It has to be an official documented API, unfortunately.

Hi can you please white-list https://apex.oracle.com/ Link for official documentation : https://docs.oracle.com/en/database/oracle/application-express/20.1/aeapi/index.html

I can't see anything on those pages that says that apex.oracle.com is itself an API -- the docs seem to be about an API built into Oracle databases. If there is an API on apex.oracle.com, could you give us a link to the docs specifically about that API?

Please refer section 43 : Using REST Administration Interface API

Reference : application-express-host:port is for standalone host, where as for cloud instance it is https://apex.oracle.com

Could you give us a link to the exact page where it says that?

Using REST Administration Interface API : https://docs.oracle.com/en/database/oracle/application-express/20.1/aeapi/Using-REST-Administration-Interface-API.html URL TERMS : https://docs.oracle.com/database/apex-18.1/AEUTL/about-Oracle-RESTful-services.htm#AEUTL447

http://<<server_address>>/<<schema_alias>>/hr/employees/7978

Sample cloud URL(Oracle's free Apex) https://apex.oracle.com/pls/apex/gravity/hr/employees/7654

where does it say apex.oracle.com is a free api that oracle provides? if we can't see that then you will have to upgrade your account.

https://apex.oracle.com/en/learn/getting-started/

Check the above link. It states, "Oracle APEX on Always Free Oracle Autonomous Database provides a preconfigured, fully managed and secured environment to both develop and deploy world-class applications. Your service remains free for an unlimited time as long as it is used."

And I am using it.

I am planning to upgrade my account, and before that I wanted to test and explore the abilities of pythonanywhere.

okay, I've whitelisted that for you.

https://gplinks.in/member/tools/api

Please whitelist this API

See my answer to your other forum post.

Thank you Conrad. will update you once i am done with the POC. :)

Hi, is it possible to whitelist polygon.io please?

We are happy to add any public api's to the whitelist if you provide us with api documentation that is hosted on that domain and shows the official api endpoints.

Please whitelist Sirv. My project fully depends on it to work, I'm currently stuck because I can't make API calls. Here are the docs; https://api.sirv.com/v2/docs

Sure, no problem -- that's done now.

hi sir can you whitelist nRF Cloud Device REST API, it is a small chip from a company in Trondheim, Norway. Small chip for IOT http://petstore.swagger.io/?url=https://docs.api.nrfcloud.com/api/api-rest.yaml server and endpoint can be found here

ProxyError at / HTTPSConnectionPool(host='www.mygov.in', port=443): Max retries exceeded with url: /covid-19 (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden')))

I have This Problem

@basirsedighi - No problem. I have added that to the whitelist. @jaswanthraj - You're getting that error because www.mygov.in is not on the whitelist. We can add sites to the whitelist if they have a publicly documented API. Send us a link to the documentation for the site's API and we'll consider it for the whitelist.

Can you please add the Clicky API to your safe list. Here is the documentation https://clicky.com/help/api? Thank you!

No problem. I have added that to the whitelist.

Can you please add TecBan to your whitelist? Here is the documentation: https://hackathon.tecban.com.br/docs/ And here are the hosts I need: https://rs1.tecban-sandbox.o3bank.co.uk ; https://as1.tecban-sandbox.o3bank.co.uk ; https://rs2.tecban-sandbox.o3bank.co.uk ; https://as2.tecban-sandbox.o3bank.co.uk

The documentation is for a generic banking API. The links you're requesting are for a specific bank implementation of that API. We need the documentation provided by the specific bank that indicates that they use the API and what the URLs are the they expose.

Can you please add : https://www.flipkart.com/ Here's the api documentation : https://seller.flipkart.com/api-docs/index.html

The flipkart API is already whitelisted - just search here (https://www.pythonanywhere.com/whitelist/) for "flipkart" to see them. If flipkart have introduced more API addresses, send us a link to the documentation page that shows the domain name they're serving it from and we'll add it to the whitelist.

still it's giving me proxy error when I'm trying to scrap the details from https://www.flipkart.com/

That's because it's still not on the whitelist.

Can you please add https://api.dutchanalytics.net/v2.1/ ? Here's the documentation: https://docs.dutchanalytics.net/docs/api and the swagger: https://api.dutchanalytics.net/v2.1/swagger/ ?

Sure, no problem -- that's whitelisted now.

can you please add https://some-random-api.ml/meme :::: documentation : https://docs.some-random-api.ml/

Sure, that's whitelisted now.

can you please add

https://meme-api.herokuapp.com/gimme

and

https://meme-api.herokuapp.com/gimme/*

there will be custom queries on the *<br> documentation :

https://github.com/R3l3ntl3ss/Meme_Api

That's documentation of a library that uses the service. We need documentation of the service itself.

hey i am accessing my own site api Sobersides.com, can we whitelist it.

We can only whitelist sites with an official public API. If your site has one, then you can put up some documentation for it (it doesn't need to be in-depth, just enough to say 'this is an official API and this is the hostname for it") and then give us a link to those docs.

Hi, Can you please whitelist "https://dev59359.service-now.com/api/now/table/kb_knowledge"

It doesn't seem to be a public API -- if there is one, please send us documentation and API endpoints.

hi, can you guys add https://samehadaku.in.net to the whitelist? but this is not api, I would be very grateful if someone added it

If the site does not have a publicly documented API then we cannot add it to the whitelist.

could you whitelist amazon.in and flipkart.com

@mayankjn Please provide us api endpoints and links to the public APIs so we could add those to our whitelist.

Hi, could you please whitelist https://api.dawum.de/ ? Its German poll data collection. Description is here: https://dawum.de/API/ (in German). Thanks!

@Politom, it's done for you.

Hi, could you please whitelist https://api.tcgplayer.com ? It's a site to buy and sell cards. The full documentation is here: https://docs.tcgplayer.com/docs . Thank you!

Sure, no problem -- that's whitelisted now.

Hi, could you whitelist government covid-19 details website , I am Scraped data from that website.

Hi, Could you please whitelist https://api.topcoder.com/

The documentation is here - https://tcapi.docs.apiary.io/#reference/reports/challenge-analyze/challenge-costs

@jaswanthraj -- we can only whitelist sites with an official public API. If the site that you want to connect to has one, please post a link to the API docs.

@Faizaan -- we need a link to the API docs from somewhere on the topcoder.com domain so that we can be sure that it's an official public API.

Hi, can I have these websites whitelisted?

I am using python to scrape tests and exams(PDF files) from these websites: 1) https://www.devoirat.net/ 2) https://www.devoir.tn/ 3) https://www.tunisiecollege.net/

Send us a link to the API documentation and we'll consider them for the whitelist.

Can you guys add https://eczite.herokuapp.com/api/users to the whitelist, I need to be able to access the site for my flask app to work

Can you guys add https://eczite.herokuapp.com/api/users to the whitelist, I need to be able to access the site for my flask app to work

We can only whitelist sites with an official public API. If the site that you want to connect to has one, please post a link to the API docs.

I think .herokuapp.com is the official link

We will not do a wildcard whitelist of the whole heroku.

Can you please whitelist this https://nithp.herokuapp.com/api/result/doc/#/ It provides student result data of my college

@CoBuddy -- we've added nithp.herokuapp.com to our whitelist.

Good evening, gentlemen! Can you please add to whitelist this api: https://api.genius.com/ Documentation's here:https://docs.genius.com/

api.genius.com is already on the whitelist -- you can see which sites are on there by checking this page.

why would you block some sites cmon man i have web scraping feature but i cant do that due to that

Free accounts tend to do things that upset the owners of the sites that they try to use, so we restrict what free users can do to prevent that.

Hi ! I have the same proxy error but I need to access a certain website for a school projet. Can you please add https://opendata.saemes.fr/explore/dataset/places-disponibles-parkings-saemes/ to the whitelist ?Thank you

Sure, no problem -- that's whitelisted now.

Thank you !

No problem :-)

Hi I have the proxy error but I also need to access a website for school project.

Message: unknown error: net::ERR_TUNNEL_CONNECTION_FAILED (Session info: headless chrome=90.0.4430.212)

Can you please add 'https://www.mangoplate.com/' to the whitelist ?

@SonJi we consider for whitelisting sites which provide programmatic access to data by exposing a public API. Please provide us with official documentation mentioning the endpoint in question and we'll see what we can do.

Good morning!

Could you please whitelist to "sandbox.controlpay.com.br"

@PowerupInnovation could you provide us with official documentation for that endpoint?

Hey could you add https://api.brawlstars.com

Its stats for a mobile game

@pkr10im -- Could you point us to the official documentation that mentions this endpoint? Btw. since you're using a paid account, you don't need it to be whitelisted.

Hi ! I have the same proxy error while trying to access https://roloca.coldfuse.io/judete. This site is required for getting country and cities of Romania. Can you please add https://roloca.coldfuse.io/ to the whitelist if it's a such issue? Thank you

Send us a link to the API documentation and we'll consider it for the whitelist.

Hi ! I saw instagram.com in white list but i.instagram.com doesnt work , can you add , please :)

i.instagram.com should be already working.

I've tested my code on my pc , it works , but I run code on pythonanywhere , I got this error : {"message":"Please wait a few minutes before you try again.","status":"fail"} How can I solve it

That just sounds like the site that you're trying to connect to is rate-limiting you.

Hi !

Do you know if it is possible to add www.basketball-reference.com on the whitelist ? I know it is not an API and I use it for scraping but is it possible or not ? Thanks for your answer!

All whitelisted domains are listed here. Apart from few exceptions, we don't whitelist non-API endpoints.

Hi ! Please add .mail.ru

Provide us with official documentation for API endpoints exposed by that domain, and we'll see what we can do.

I'm new to programming, maybe there are API endpoints here that you're talking about https://api.mail.ru/docs/

Could you point to the place in the docs there the API base url is mentioned (or at least to the English version of the documentation)?

perhaps here you will find what you are requesting https://github.com/kireevmp/mailru-cloud-api/blob/master/cloud.mail.ru_API.md

We support only official docs. We were able to find an endpoint mentioned here: [https://api.mail.ru/docs/guides/restapi/[(https://api.mail.ru/docs/guides/restapi/), so I'm whitelisting api.mail.ru for you.

thank you very much

Could you whitelist this site 'ims-na1.adobelogin.com'?

Send us a link to the API documentation and we'll consider it for the whitelist.

Hello, Kindly add https://api.shrtco.de/v2/ to your whitelist. This is the link to their api documentation, https://shrtco.de/docs/

@rogueman It's done.

Sir can you please add https://oauth.accounting.sage.com, https://www.sageone.com, https://api.accounting.sage.com to the white list?

Auth API https://developer.sage.com/api/accounting/quick_start_guide/create-your-first-request/ Data API https://developer.sage.com/api/accounting/api/

No problem. I have added those to the whitelist.

I see in PythonAnywhere whitelist api-invest.tinkoff.ru but not invest-public-api.tinkoff.ru

Is it possible to white list this URL?

a link to the API documentation https://www.tinkoff.ru/invest/open-api/ and https://tinkoff.github.io/investAPI/grpc/

OK, we've whitelisted invest-public-api.tinkoff.ru for you.

requests.exceptions.SSLError: HTTPSConnectionPool(host='iss.moex.com', port=443): Max retries exceeded with url:

@calcgpa Hi, Thank you for your message. If you would like the above endpoint to be considered for the whitelist , please send us a link to the API documentation and please also send a link to the official domain. Please note we can only whitelist sites with an official public API.

Hello

I have a problem with the movie database API.

I'm using simpletmdb library and while searching through the api I get error. API_KEY_ERROR. No request is is working from server.

Hello

I have a problem with the movie database API.

I'm using simpletmdb library and while searching through the api I get error. API_KEY_ERROR. No request is is working from server.

If you are getting that error, you need to provide a valid API key to the site. Check the documentation for the library to see how to provide that.

Could you please put https://www.ons.org.br/AcervoDigitalDocumentosEPublicacoes/ and https://ons-dl-prod-opendata.s3.amazonaws.com/dataset/

@ddder Hi, Thank you for your message. If you would like the above domain to be considered for the whitelist , please send us a link to the API documentation and please also send a link to the official domain. Please note we can only whitelist sites with an official public API.

Please put this API on the whitelist: https://data.aishub.net/

Documentation: https://www.aishub.net/api

Thanks!

@krispython Hi, Thank you for your request. data.aishub.net has now been added to the whitelist.

Please put this API on the whitelist: https://dhlottery.co.kr/

This is a Korean lotto site. Contact us because the same error occurs while crawling the corresponding page. I couldn't find the api documentation

If there is no API documentation, then it is not a site that we can add to the whitelist.

please add try.indio.co

documentation : https://github.com/IndicoDataSolutions/indico-client-python

You'll find all the instructions for requesting allowlist additions here.

Please put this API on the whitelist: https://intelligenzaartificialeitalia.net/

Documentation: https://intelligenzaartificialeitalia.net/api

// BINARY SENTIMENT // endpoint : https://intelligenzaartificialeitalia.net/_functions/sentiment?text=i%20love%20you%20my%20friend

// Emotion SENTIMENT // endpoint : https://intelligenzaartificialeitalia.net/_functions/emotion?text=i%20love%20you%20my%20friend

// START REVIW SENTIMENT // endpoint : https://intelligenzaartificialeitalia.net/_functions/reviewStar?text=i%20love%20you%20my%20friend

and more evry update. PLS ADD :)

@IAITALIA You'll find all the instructions for requesting allowlist additions here.

@pafk thank you very much, how long is the review time before adding it to the allowlist?

@IAITALIA Not too long. Normally up to 24h on the working day.

Thanks for the reply, will I receive an email or a notification in case of approval or rejection?

Thanks for the reply, will I receive an email or a notification in case of approval or rejection?

Yes, they will email you.

Can you please whitelist this website - https://www.espncricinfo.com/

You'll find all the instructions for requesting allowlist additions here.

Hello i upgraded my account from the free acount to the paid account however i cant still make requests to an external api, how is it so yet am on paid account

@tukore My guess is that you're running your code in a console that have been created before the upgrade. Please start a new one and check if you can successfuly make the call. The other possibility is that the API is not behaving in a way you think it is, but we'd need more data to debug it.

Hi please add api.paymongo.com

@mygomo16 You'll find all the instructions for requesting allowlist additions here.

Hi I want to add https://www.time.ir/ in white list but the API documentation is not available what should I do?

If there's no public api documentation then it wont be whitelisted. You'll need a paid account to access it

Whitelist "https://www.skyscanner.co.in/g/radar/api/v2/web-unified-search/"

You'll find all the instructions for requesting allowlist additions here.

Can someone please allow a host "www.pakwheels.com" as I have created a project to scrape real=time data from this website to draw some graphs. This is my university FYP and I want to present it to my mentors. There is no API available unfortunately.

Please help

You'll find all the instructions for requesting allowlist additions here.

Hi. I need to connect to 'https://uat.finserve.africa/authentication/api/v3/authenticate/merchant' api for testing. The documentation is at 'https://developer.jengahq.io/'. could you whitelist the url for me

@kingkish Make sure to follow instructions for requesting allowlist additions here.

Sir Can you please whitelist this https://students.cuchd.in/ It provides student result data of my college

Make sure to follow instructions for requesting allowlist additions here.