0

I am currently building an app with Quart that web scrapes an external site for data. Because this can take several minutes, I made the scraping a background task to avoid request timeouts.

After the user provides a user ID to a form on the home page, the app sets a background task to scrape the data and in the meantime, the user is redirected to a loading page.

@app.route('/')
async def index():

    form = await request.form      
    id = int(form['user_id'])

    # set the background task
    app.add_background_task(task_to_do, user_id=id)

    return redirect('/loading')

@app.route('/loading')
async def loading():    
    return await render_template('loading.html')

Currently, the user is successfully redirected to the loading page and the scraping background task finishes no problem.

At the completion of my task_to_do background task, I want the user to be redirected to a new page. How would one go about doing that?

BarleyZP
  • 3
  • 1

1 Answers1

0

I think you want to utilise Server Sent Events. This is where the client creates a connection to the server and waits for events from it. You could first send a loading event, and then when the computation completes send a result event. There is a guide in the Quart docs for Server Sent Events.

E.g. something like the code below (using the ServerSentEvent class from the docs). Note the user_id needs to be a path parameter as SSE works over GET requests.


from quart import abort, make_response

@app.get('/<int:id_>')
async def index(id_):
    if "text/event-stream" not in request.accept_mimetypes:
        abort(400)

    async def send_events():
        event = ServerSentEvent("loading")
        yield event.encode()
        data = await task_to_do(user_id=id_)
        event = ServerSentEvent(json.dumps(data))
        yield event.encode()

    response = await make_response(
        send_events(),
        {
            'Content-Type': 'text/event-stream',
            'Cache-Control': 'no-cache',
            'Transfer-Encoding': 'chunked',
        },
    )
    response.timeout = None
    return response
pgjones
  • 6,044
  • 1
  • 14
  • 12