pysha3 not giving the right answer

Question

With the following code,

# $ pip install pysha3
import sys
if sys.version_info < (3, 4):
    import sha3

import hashlib

s = hashlib.new("sha3_512")

s.update(b"")
print(s.hexdigest())

I am getting

0eab42de4c3ceb9235fc91acffe746b29c29a8c366b7c60e4e67c466f36a4304c00fa9caf9d87976ba469bcbe06713b435f091ef2769fb160cdab33d3670680e

instead of

a69f73cca23a9ac5c8b567dc185a756e97c982164fe25859e0d1dcc1475c80a615b2123af1f5f94c11e3e9402c3ac558f500199d95b6d3e301758586281dcd26

cf. https://en.wikipedia.org/wiki/SHA-3#Examples_of_SHA-3_variants

Could anyone advise me?

You could include a link to the [Wikipedia page](https://en.wikipedia.org/wiki/SHA-3#Examples_of_SHA-3_variants). — Martijn Pieters, Feb 11 '16 at 08:11
@MartijnPieters: I have to say, I find that edit *very* unhelpful. (For example, it makes it much harder to check for an endian problem.) Anything which forces SO to display horizontal scroll bars is a BadThing(TM) in my opinion. I don't see what was wrong with a proportional font for the display. — Martin Bonner supports Monica, Feb 11 '16 at 08:16
Have you tried reporting a bug to the `pysha3` project? I don't see anything specifically wrong with your approach. — Martijn Pieters, Feb 11 '16 at 08:19
@MartinBonner: I was more concerned with producing actual output for the code shown. Feel free to use a blockquote instead of a code block. — Martijn Pieters, Feb 11 '16 at 09:03

Martijn Pieters · Accepted Answer · 2016-02-11T11:16:01.447

The pysha3 module you found was based on an draft of the SHA-3 specification, before it was standardised.

The module was created as a POC for Python issue 16113, and the code has not been updated since 2012. The NIST standard wasn't finalised until October 2015. As such, the implementation can't be used if you expect it to follow the released standard.

That ticket links to an implementation that does claim to have been updated to the standard: https://github.com/bjornedstrom/python-sha3. That package doesn't appear to be listed on PyPI, but can be installed with pip directly from GitHub:

pip install git+https://github.com/bjornedstrom/python-sha3

and this package does produce the expected result:

>>> import hashlib
>>> import sha3
>>> hashlib.sha3_512(b'').hexdigest()
b'a69f73cca23a9ac5c8b567dc185a756e97c982164fe25859e0d1dcc1475c80a615b2123af1f5f94c11e3e9402c3ac558f500199d95b6d3e301758586281dcd26'

This package doesn't patch the built-in hashlib.new() constructor, but that's easily done by plugging in the constructor into the module cache:

>>> hashlib.__builtin_constructor_cache['sha3_512'] = sha3.sha3_512
>>> hashlib.new('sha3_512')
<sha3.SHA3512 object at 0x10b381a90>

I am seeing "sha3.c:27:20: fatal error: Python.h: No such file or directory compilation terminated. error: command 'x86_64-linux-gnu-gcc' failed with exit status 1 " — Ursa Major, Feb 17 '16 at 00:02
follow by " Cleaning up... Command /usr/bin/python -c "import setuptools, tokenize;__file__='/tmp/pip-do9L2k-build/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-NjGrG3-record/install-record.txt --single-version-externally-managed --compile --user failed with error code 1 in /tmp/pip-do9L2k-build Storing debug log for failure in /home/michachan/.pip/pip.log " — Ursa Major, Feb 17 '16 at 00:02

score 0 · Answer 2 · answered Jan 29 '17 at 18:45

SHA3 has been added to the built-in hashlib module in Python 3.6:

What’s New In Python 3.6

The SHA-3 hash functions sha3_224(), sha3_256(), sha3_384(), sha3_512(), and SHAKE hash functions shake_128() and shake_256() were added. (Contributed by Christian Heimes in issue 16113. Keccak Code Package by Guido Bertoni, Joan Daemen, Michaël Peeters, Gilles Van Assche, and Ronny Van Keer.)

It can be used in the follow way:

>>> import sys
>>> import hashlib
>>> s = hashlib.new("sha3_512")    # sha3_224, sha3_256 and sha3_384 are also available
>>> s.update(b"")
>>> print(s.hexdigest())
a69f73cca23a9ac5c8b567dc185a756e97c982164fe25859e0d1dcc1475c80a615b2123af1f5f94c11e3e9402c3ac558f500199d95b6d3e301758586281dcd26

pysha3 not giving the right answer

2 Answers2