How to remove punctuation within a string?

Question

I am doing text cleaning for my pandas dataframe

This is a string from my description column before punctuation is removed:

['dedicated', 'to', 'support', 'the', 'fast-paced', 'technology', 
'lifestyle', 'needs', 'of', 'today', 'â€™', 's', 'modern', 'society', 
'.', 'gadget', 'mix', 'have', 'the', 'benefit', 'of', 'â€œ', 
'efficient', 'life', 'â€', 'tied', 'to', 'the', 'products', 'and', 
'services', 'they', 'provide', '.']

This is how the string look like after i applied the code below:

['dedicated', 'to', 'support', 'the', 'fast-paced', 'technology', 
'lifestyle', 'needs', 'of', 'today', 'â€™', 's', 'modern', 'society', 
'gadget', 'mix', 'have', 'the', 'benefit', 'of', 'â€œ', 'efficient', 
'life', 'â€', 'tied', 'to', 'the', 'products', 'and', 'services', 
'they', 'provide']

This is my code:

#removing punctuation
import string
punc=string.punctuation
updated_mall['Cleansed_description']=update_mall['Cleansed_description'].apply(lambdax: [word for word in x if word not in punc])
update_mall.head(105)

This code did remove punctuation except:

words like "Fast-paced","...","restaurant/catering".

Other than that,after punctuation removal and changing to lower casing words like Asia's became 'asia' and 's.

I was told that this only check an entire string if is a punctuation instead of checking every single word in a string for punctuation.

score 1 · Answer 1 · edited Feb 12 '23 at 08:08

1

Can you try the below code using regex

import re

updated_mall['Cleansed_description']=update_mall['Cleansed_description'].apply(lambda x: [re.sub(r'[^\w\d\s]', ' ', word.lower()) for word in x])

update_mall.head(105)

edited Feb 12 '23 at 08:08

il_raffa

5,090
129
31
36

answered Feb 08 '23 at 12:38

Manoj biroj

288
1
6

hi,i've tried and got an error:'list' object has no attribute 'lower' – bird Feb 08 '23 at 12:44
I have updated the code, can you try that once – Manoj biroj Feb 08 '23 at 12:48
hi,yes your code worked. Thank you.Other than that for string with weird character like â€™ it return me a '' is there a way to just return nothing other than a ''. – bird Feb 08 '23 at 13:12
I think those are not special characters, they are some other characters. – Manoj biroj Feb 08 '23 at 15:22

How to remove punctuation within a string?

1 Answers1