Accessing POST Data from WSGI

Question

I can't seem to figure out how to access POST data using WSGI. I tried the example on the wsgi.org website and it didn't work. I'm using Python 3.0 right now. Please don't recommend a WSGI framework as that is not what I'm looking for.

I would like to figure out how to get it into a fieldstorage object.

FWIW, at this point in time there is still no WSGI specification for Python 3.0, so anything you do will possibly be wasted effort as any final specification update may not be compatible with anyones attempts to implement what it may say for Python 3.0. For WSGI applications you are better off staying with Python 2.X. — Graham Dumpleton, Aug 02 '09 at 11:52
@GrahamDumpleton Not anymore: http://www.python.org/dev/peps/pep-3333/ (Let's not mislead people who read this a bit later like me - saving their time too) — jeromej, Sep 03 '13 at 09:39
@JermoeJ - He wrote the comment in 2009, and you are replying to it in 2013; don't think he was trying to mislead anyone. :) — Sam, Apr 30 '15 at 05:00

score 31 · Accepted Answer · edited Feb 15 '09 at 03:05

31

Assuming you are trying to get just the POST data into a FieldStorage object:

# env is the environment handed to you by the WSGI server.
# I am removing the query string from the env before passing it to the
# FieldStorage so we only have POST data in there.
post_env = env.copy()
post_env['QUERY_STRING'] = ''
post = cgi.FieldStorage(
    fp=env['wsgi.input'],
    environ=post_env,
    keep_blank_values=True
)

edited Feb 15 '09 at 03:05

Constantin

27,478
10
60
79

answered Feb 15 '09 at 01:55

Mike Boers

6,665
3
31
40

This doesn't work in Python 3.0 - it has a problem with the wsgi.input returning bytes instead of strings. :( I need a way of doing this in Python 3.0... – Evan Fosmark Feb 15 '09 at 08:56
What WSGI handler are you using? If I use the built-in CGIHandler it works just fine for me. I have a file "post.cgi" on my local server with the contents at http://pastebin.com/f40849562 running just fine. – Mike Boers Feb 15 '09 at 16:41
What io class is the wsgi.input? If it is a BufferedIOBase then you should be able to wrap it in a TextIOWrapper so that the cgi.FieldStorage can use it. – Mike Boers Feb 15 '09 at 17:11
@Mike, I thought of that too, but that would make it not function properly in the long run as post data can be binary (eg, files). – Evan Fosmark Feb 15 '09 at 20:35
@Evan, Maybe I'm crazy, but you *could* wrap the input in a TextIOWrapper and extend the FieldStorage and override the `make_file` method to return your own wrapper around a file which encodes back to binary data as it writes... If this can't be done an easier way. Which WSGI handler are you using? – Mike Boers Feb 16 '09 at 03:34
@Mike, I'm just using wsgiref, which on its own took a lot of modification to get working in 3.0. – Evan Fosmark Feb 18 '09 at 23:35
@Evan: Any particular handler, or the CGIHandler? Cause that one is working just fine for me with 3.0. Maybe I'm not pushing it very hard? – Mike Boers Feb 19 '09 at 03:14
@Mike, I'm using WSGIServer. I haven't tried it with CGIHandler, but I'd prefer not to ever have to use that since it sort of breaks the point of WSGI in my opinion. – Evan Fosmark Feb 19 '09 at 17:01
@Evan: Well that is really broken in 3.0, isn't it? I'll play around with it in the near future (cause I am interested in moving to 3.0 for my apps) and post results here. – Mike Boers Feb 19 '09 at 18:01

score 24 · Answer 2 · answered Feb 10 '09 at 01:56

body= ''  # b'' for consistency on Python 3.0
try:
    length= int(environ.get('CONTENT_LENGTH', '0'))
except ValueError:
    length= 0
if length!=0:
    body= environ['wsgi.input'].read(length)

Note that WSGI is not yet fully-specified for Python 3.0, and much of the popular WSGI infrastructure has not been converted (or has been 2to3d, but not properly tested). (Even wsgiref.simple_server won't run.) You're in for a rough time doing WSGI on 3.0 today.

Yeah I had issues getting wsgiref to work. I ended up implementing the patch. — Evan Fosmark, Feb 10 '09 at 02:12

score 5 · Answer 3 · edited Nov 09 '11 at 18:04

5

This worked for me (in Python 3.0):

import urllib.parse

post_input = urllib.parse.parse_qs(environ['wsgi.input'].readline().decode(),True)

edited Nov 09 '11 at 18:04

Jason Plank

2,336
5
31
40

answered Oct 15 '09 at 14:44

Jack

67
1
2

score 2 · Answer 4 · answered Jul 26 '21 at 21:52

I had the same issue and I invested some time researching a solution.
the complete answer with details and ressources (since the one accepted here didnt work for me on python3, many errors to correct in env library etc):

# the code below is taken from and explained officially here:
# https://wsgi.readthedocs.io/en/latest/specifications/handling_post_forms.html
import cgi
def is_post_request(environ):
    if environ['REQUEST_METHOD'].upper() != 'POST':
        return False
    content_type = environ.get('CONTENT_TYPE', 'application/x-www-form-urlencoded')
    return (content_type.startswith('application/x-www-form-urlencoded' or content_type.startswith('multipart/form-data')))
def get_post_form(environ):
    assert is_post_request(environ)
    input = environ['wsgi.input']
    post_form = environ.get('wsgi.post_form')
    if (post_form is not None
        and post_form[0] is input):
        return post_form[2]
    # This must be done to avoid a bug in cgi.FieldStorage
    environ.setdefault('QUERY_STRING', '')
    fs = cgi.FieldStorage(fp=input,
                          environ=environ,
                          keep_blank_values=1)
    new_input = InputProcessed()
    post_form = (new_input, input, fs)
    environ['wsgi.post_form'] = post_form
    environ['wsgi.input'] = new_input
    return fs
class InputProcessed(object):
    def read(self, *args):
        raise EOFError('The wsgi.input stream has already been consumed')
    readline = readlines = __iter__ = read

# the basic and expected application function for wsgi
# get_post_form(environ) returns a FieldStorage object
# to access the values use the method .getvalue('the_key_name')
# this is explained officially here:
# https://docs.python.org/3/library/cgi.html
# if you don't know what are the keys, use .keys() method and loop through them
def application(environ, start_response):
    start_response('200 OK', [('Content-type', 'text/plain')])
    user = get_post_form(environ).getvalue('user')
    password = get_post_form(environ).getvalue('password')
    output = 'user is: '+user+' and password is: '+password
    return [output.encode()]

score -2 · Answer 5 · answered Feb 09 '09 at 23:33

-2

I would suggest you look at how some frameworks do it for an example. (I am not recommending any single one, just using them as an example.)

Here is the code from Werkzeug:

http://dev.pocoo.org/projects/werkzeug/browser/werkzeug/wrappers.py#L150

which calls

http://dev.pocoo.org/projects/werkzeug/browser/werkzeug/utils.py#L1420

It's a bit complicated to summarize here, so I won't.

answered Feb 09 '09 at 23:33

Ali Afshar

40,967
12
95
109

Still doesn't work in Python 3.0, and that's what I'm looking for. Thanks anyways, though. – Evan Fosmark Feb 15 '09 at 08:57
2

@FireCrow Looking at how frameworks do seems to be a good idea though. This isn't really advising a framework way. – jeromej Sep 03 '13 at 09:25
2

Links are dead, though. – Soravux Feb 24 '14 at 02:37

Accessing POST Data from WSGI

5 Answers5

Linked

Related