I would like some suggestions with the following. I have a Django Web App. A request can be sent to the app that will contain a parameter that is an external url. I want to add this url to a queue to be scraped. I read that there is no thread support in the web app so i want to add it to an always-on-task that picks them up. How can i do this? What is the best way of doing this? The always-on-task, after scraping, has to add the information scraped to the database used by django.
I read some similar topics, but i couldn't find exactly the answer.