how to convert large file (90+ Mb) from gb2312 to utf-8
Home New Posts
Login: Pass: Log in or register for standard view and full access.
alexkos -
Hi!
The problem is that iconv, the main tool for converting files can not process files of such a big
size!
PS I'm using a Mac, so any UNIX solutions will work + can emulate WinXP
Pleco Software Learn Chinese with our Dictionaries for Palm and Pocket PC.
Learn Chinese in China Learn to speak Chinese 1MonthChinese.com -Mandarin School in China.
Chinese Textbooks Wide range, cheap, varied languages. Also Chinese cartoons, toys, gifts.
Study Chinese in Beijing Affordable Mandarin language courses at BLCU with ChinaUnipath.com.
HNHSoft Dictionary Learn Chinese on Smartphone and PDA with real person's voice.
XueXueXue IQChinese Get beyond the plateau.Take your Mandarin to a new level.
Chinese in Lijiang Short term Chinese study in a beautiful town with a focus on daily life.
MandarinTube Chinese Access to current everyday Chinese language and culture, 24/7.
Learn Chinese Homestay Chinese course, cultural activities & volunteer events in China.
Learn Chinese Online 1-on-1 instant tutoring, diverse courses, native teachers. FREE trial now!
Nihao Chinese Progam Free one-on-one Chinese lesson. Win 5-years of free lessons now!
About Ads (and how to hide them) -- Your message here
imron -
Open the file in vi. Type the following commands:
:set encoding=gb2312
:set fileencoding=utf8
:w myfile.utf8
:q
Vi will be using iconv to do the conversions, but it will possibly be doing it line by line so
iconv should be able to handle it. Make sure you save to a different filename than the original,
just in case something goes wrong and the original 90mb file is lost.
c_redman -
perl -MEncode -ne "binmode STDOUT, ':utf8'; print decode('euc-cn', $_)" < test.gb > test.u8
alexkos -
非常感谢!!!
thanks a lot!
Another solution is: open the file using Wenlin... surprisingly, it can handle 90 mb files
All times are GMT +8. The time now is 04:59 PM.
chinese language, learning chinese china, HSK, learn chinese writing, learn chinese characters, HSK Exam, chinese school, teach chinese, chinese schools, learn mandarin, learning mandarin, learning chinese, study in chinese, learn chinese abroad, speak chinese, chinese studies, how to learn chinese, learn chinese china, learn chinese online, chinese language online, learn chinese in china, study chinese online, chinese language program, chinese language school, chinese language schools, chinese speaking, learn chinese, learn mandarin online, learn to write chinese, beijing chinese language school, chinese language china, chinese language classes, chinese language courses, chinese language learning,

No comments:
Post a Comment