0

I'm trying to post the data from a DataFrame file to the Watson Personality Insights API using Object storage in IBM DataScienceExperience..

I've loaded the txt file into ObjectStorage and created a DataFrame. Works fine. Don't understand how to post the data in the dataframe to the API. The provided documentation does not point me into the right direction.

This is what I've done

from io import StringIO
import requests
import json
import pandas as pd

def get_object_storage_file_with_credentials(container, filename):
    """This functions returns a StringIO object containing
    the file content from Bluemix Object Storage."""

    url1 = ''.join(['https://identity.open.softlayer.com', '/v3/auth/tokens'])
    data = {
        'auth': {
            'identity': {
                'methods': ['password'],
                'password': {
                    'user': {
                        'name': 'UID UID UID',
                        'domain': {
                            'id': 'ID ID ID'
                        },
                    'password': 'PASS PASS'
                    }
                }
            }
        }
    }
    headers1 = {'Content-Type': 'application/json'}
    resp1 = requests.post(url=url1, data=json.dumps(data), headers=headers1)
    resp1_body = resp1.json()

    for e1 in resp1_body['token']['catalog']:
        if(e1['type']=='object-store'):
            for e2 in e1['endpoints']:
                if(e2['interface']=='public'and e2['region']=='dallas'):
                    url2 = ''.join([e2['url'],'/', container, '/', filename])

    s_subject_token = resp1.headers['x-subject-token']
    headers2 = {'X-Auth-Token': s_subject_token, 'accept': 'application/json'}
    resp2 = requests.get(url=url2, headers=headers2)

    return StringIO(resp2.text)

PI_text = get_object_storage_file_with_credentials('MyDSXProjects', 'myPI.txt')

Next I want to post the DataFrame content to the API I would like to know how, hope someone can provide a tip... My Python knowledge is lacking here.

Oluwafemi Sule
  • 36,144
  • 1
  • 56
  • 81
Brenzef
  • 1

1 Answers1

0

According to the Watson Personality Insights API reference, you can provide text, HTML or JSON input. You dataset is available as a pandas dataframe. Try converting the relevant column in the DataFrame to text format. For example by:

pi_api_text = PI_text['<TEXT_COLUMN>'].str.cat(sep='. ').encode('ascii', 'ignore')

Make sure you have the Python package installed:

pip install --upgrade watson-developer-cloud

Once you have the relevant data in text format make a call to the Watson Personality Insights API. For example as:

personality_insights = PersonalityInsightsV3(
 version='xxxxxxxxx',
 username='xxxxxxxxxx',
 password='xxxxxxxxxx')
profile = personality_insights.profile(
 pi_api_text, content_type='text/plain',
 raw_scores=True, consumption_preferences=True)

The response will be a JSON object containing the personality traits, which you can re transform to a pandas dataframe.

Sumit Goyal
  • 575
  • 3
  • 16
  • Hi Sumit, The text in the PI_text object is unstructured data. I want to Post this text to the Watson Personality insights API and store the results into a DataFrame that I will later join with another DataFrame for analysis. So it's really about posting the ObjectStorage Object to the API. – Brenzef Sep 11 '17 at 13:13
  • @Brenzef, After converting the relevant column from the dataframe to text format, you can make an api call to the Watson Personality Insights API. Let me edit the answer accordingly. – Sumit Goyal Sep 11 '17 at 15:17