Скачать или смотреть How to Replace Chinese Punctuations with Corresponding English Ones in Python

A guide on how to effectively replace Chinese punctuations with English counterparts in Python using regular expressions and Pandas.
---
This video is based on the question https://stackoverflow.com/q/64853593/ asked by the user 'ah bon' ( https://stackoverflow.com/u/8410477/ ) and on the answer https://stackoverflow.com/a/64853617/ provided by the user 'jezrael' ( https://stackoverflow.com/u/2901002/ ) at 'Stack Overflow' website. Thanks to these great users and Stackexchange community for their contributions.

Visit these links for original content and any more details, such as alternate solutions, latest updates/developments on topic, comments, revision history etc. For example, the original title of the Question was: Replace specific chinese punctuations with correspondent english ones in Python

Also, Content (except music) licensed under CC BY-SA https://meta.stackexchange.com/help/l...
The original Question post is licensed under the 'CC BY-SA 4.0' ( https://creativecommons.org/licenses/... ) license, and the original Answer post is licensed under the 'CC BY-SA 4.0' ( https://creativecommons.org/licenses/... ) license.

If anything seems off to you, please feel free to write me at vlogize [AT] gmail [DOT] com.
---
How to Replace Chinese Punctuations with Corresponding English Ones in Python

If you've ever worked with multilingual datasets, you may have encountered a situation where you need to replace specific characters or punctuations from one language with their counterparts in another. This is especially common in data manipulation tasks using Python.

In this guide, we'll explore how to effectively replace Chinese punctuation marks with their English equivalents within a dataset using the Pandas library. Let's take a closer look at the problem, the incorrect approach you might have tried, and the right way to achieve the desired results.

The Problem: Replacing Chinese Punctuation

Consider a simple dataset that consists of company names with Chinese punctuation. Here's how it looks:

[[See Video to Reveal this Text or Code Snippet]]

This dataset contains several instances of Chinese punctuation that you want to replace with their English counterparts:

Replace （ with (

Replace ） with )

Replace 。 with .

Replace ， with ,

Attempting to solve this with a basic chained replace function might look something like this:

[[See Video to Reveal this Text or Code Snippet]]

However, this approach is not only non-pythonic but also doesn’t always yield the expected results, as we can see from the output. Here's what you might have received, demonstrating the failure of the common chain replace approach:

[[See Video to Reveal this Text or Code Snippet]]

The Solution: Using Regex for Replacement

To accurately replace the Chinese punctuation, we can utilize a more efficient method using regular expressions. Below are two effective methods that you can choose from, depending on your preference:

Method 1: List Replacement with Regex

You can create two lists, one for the Chinese punctuations and another for the corresponding English punctuations, and use the replace function with regex=True. Here’s how it looks:

[[See Video to Reveal this Text or Code Snippet]]

Method 2: Dictionary Replacement with Regex

Alternatively, you can also use a dictionary to map the Chinese punctuation to their English equivalents, which can lead to more readable and maintainable code. Here’s the method:

[[See Video to Reveal this Text or Code Snippet]]

Both methods will successfully convert the Chinese punctuation marks to their English counterparts, giving you a clean output.

Conclusion

Replacing Chinese punctuation marks with English counterparts in a dataset is a common task that can easily be accomplished using the Pandas library in Python. By leveraging the power of regular expressions, you can ensure that the replacements are accurate and efficient.

Whether you choose to use lists or dictionaries for this task, the key takeaway is to utilize the replace function with the regex=True parameter, which allows you to perform bulk replacements effectively.

Now you can confidently handle multilingual datasets in your Python projects!