PDA

View Full Version : Character set support



Jason
08-07-2009, 05:01 AM
If you are seeing boxes instead of the proper characters, check these things:

1) Make sure th font you are using actually has the characters you need! If you set the cvar "font_writeBitmaps" to true, when the game starts it will write out images of all the font faces it creates to your user directory (/My Documents/Heroes of Newerth/game on a windows machine)

2) Make sure your string tables are in a Unicode format. The game can read UTF-8, UTF-16 big/little endian and UTF-32. It check for a BOM or "byte order mark" at the start of the file, if this is an option in the editor you are using, be sure it is enabled.

3) In the core_xx.resources file the fonts are declared. Inside of the <fontface> tag, you can specify which character sets are generated with the language="xxx" property. You can include multiple character sets, separated by commas, e.g. language="latin,hiragana,katakana"

For reference, you can check out the character set ranges here: http://www.alanwood.net/unicode/unicode_samples.html

Currently supported:
latin (includes "Basic Latin" and "Latin-1 Supplement", range 0000 to 00ff)
greek
cyrillic
hebrew
arabic
hangul_jamo
hiragana
katakana
cjk
hangul_syllable

Included in next patch (1.34):
latin (range extended to 0000 to 024f, now includes "Latin Extended-A" and "Latin-Extended-B")
greek
cyrillic (extended range to include "Cyrillic Supplement")
armenian
hebrew
arabic
devangari
bengali
gurmukhi
gujarati
thai
hangul_jamo
tagalog
mongolian
hiragana
katakana
cjk
hangul_syllable

Let me know if there is a character set you need that is not included in this list and I will add it.

gerbercage
08-07-2009, 05:37 AM
wah nice, I can type chinese word in chat box soon.

nongnoobjung
08-07-2009, 07:48 AM
wow nice

support thai

quaq
08-07-2009, 08:23 AM
i don't see character set for czech

Jason
08-07-2009, 09:42 AM
i don't see character set for czech

Latin should work for Czech, I know there are currently a few missing but the extended range in the next patch should provide all of them.

OfekA
08-11-2009, 07:50 AM
Hebrew is a Right to Left language, just like Arabic. Is it possible to change the direction when you change the language as well?

DrRisan
08-11-2009, 07:57 AM
Indeed, talking about arabic we got urdu which is usually spoken in Pakistan and the areas around that, based on arabic it is from right to left.

When you first have bengali (Bangladesh) and gujarati (mainly India but Pakistan and some African countries) speaks it to. Why not support urdu aswell, based off persian.

yorii
08-11-2009, 08:18 PM
I'm still annoyed you can't write special chars in the password box...

Good thing it saves properly since last patch though, had to paste my password everytime earlier :P

Weedbean
08-14-2009, 04:40 PM
Hey, are the following characters supported in any character set yet?

"æ, ø, å", danish letters.

Thanks in advance.


EDIT: I found out, I just had to save my edited .str files as Unicode Text Document instead of Text Document.

kadeve
08-16-2009, 06:16 PM
i would like to see the game supports Turkish

HeK1
08-18-2009, 08:57 AM
Jason (http://forums.heroesofnewerth.com/member.php?u=7)

hello, is utf-8 supported in language="utf-8" ??

kadeve
08-19-2009, 09:01 AM
http://www.geocities.com/click2speak/unicode/chars_tr.html



http://www.hontr.com/turkish.gif

IAmRoot
08-20-2009, 10:44 PM
Jason (http://forums.heroesofnewerth.com/member.php?u=7)

hello, is utf-8 supported in language="utf-8" ??

well, you can encode in utf8, utf16, etc., but you have to specify which character sets to load.


http://www.geocities.com/click2speak/unicode/chars_tr.html



http://www.hontr.com/turkish.gif

Those should be in language="latin"

HeK1
08-21-2009, 03:34 AM
IAmRoot (http://forums.heroesofnewerth.com/member.php?u=286)
language="utf8" ?? it doesn't work

kadeve
08-21-2009, 05:45 AM
its just doesnt work

http://www.hontr.com/trrr.jpg

either the chars are not visible or they look like lines and boxes

1) my font is BT so it supports all my chars. and i can see the bitmaps file my characters are shown there too

2)utf-8 done. but not just the things in language file also the thing we write is not shown..

3) tried latin,turkish still doesnt work.. WE cant see ğüşıöç ĞÜŞİÖÇ

and this makes our chats completely look stpuid and cant communicate

kadeve
08-22-2009, 01:21 PM
bump. plz fix this thing!!!!!

Gentoo
08-22-2009, 05:32 PM
latin doesnt work for polish symbols!

please add: ą, ć, ę, ń, ś, ż, ź

IAmRoot
08-22-2009, 05:55 PM
Post your files and I'll have a look. Make sure you're using language="latin"

kadeve
08-22-2009, 06:32 PM
<?xml version="1.0" encoding="UTF-8"?>
<resourcelist>
<fontface file="/core/fonts/game_tr.ttf">
<fontmap name="dyn_6" size="6" dynamic_fontsize="true" baseresolution="768" axis="y" language="latin"/>
<fontmap name="dyn_7" size="7" dynamic_fontsize="true" baseresolution="768" axis="y" language="latin"/>
<fontmap name="dyn_8" size="8" dynamic_fontsize="true" baseresolution="768" axis="y" language="latin"/>
<fontmap name="dyn_9" size="9" dynamic_fontsize="true" baseresolution="768" axis="y" language="latin"/>
<fontmap name="dyn_10" size="10" dynamic_fontsize="true" baseresolution="768" axis="y" language="latin"/>
<fontmap name="dyn_11" size="11" dynamic_fontsize="true" baseresolution="768" axis="y" language="latin"/>
<fontmap name="dyn_12" size="12" dynamic_fontsize="true" baseresolution="768" axis="y" language="latin"/>
<fontmap name="dyn_14" size="14" dynamic_fontsize="true" baseresolution="768" axis="y" language="latin"/>
<fontmap name="dyn_16" size="16" dynamic_fontsize="true" baseresolution="768" axis="y" language="latin"/>
</fontface>

<fontface file="/core/fonts/system_tr.ttf">
<fontmap name="system_small" size="10" />
<fontmap name="system_medium" size="12" language="latin"/>
<fontmap name="system_large" size="22" language="latin"/>
</fontface>

<fontface file="/core/fonts/game_tr.ttf">
<fontmap name="littletextpopup" size="16" dynamic_fontsize="true" baseresolution="768" axis="y" language="latin"/>
</fontface>

<cursor name="cursor" file="/core/cursors/arrow.cursor" />

<texture name="alphagrad" file="$alphagrad" />
<texture name="logo" file="/textures/logo.tga" />
<texture name="console_background" file="/core/textures/console_blank.tga" />
</resourcelist>



its not just the translations we also cant see those characters when we type them in game

IAmRoot
08-22-2009, 06:38 PM
Make sure that font supports those characters. Those characters are definitely in the loaded range, but the font may not contain them.

kadeve
08-22-2009, 06:47 PM
the font is fine.. i download the same font with BT which supports the chars missing in game. (Im also a programmer and i definetly know what Im doing)
game doesnt support those chars try it yourself

ğ ü ı ş ö ç

Gentoo
08-22-2009, 07:00 PM
Oh yes, for polish it worked. Thank you

kadeve
08-23-2009, 08:48 PM
still no solution for us...

Gentoo
08-24-2009, 08:27 AM
There are also 2 symbols which are in font but do not work in game

its Ż and ż

kadeve
08-24-2009, 08:33 AM
CFontMap::AddCharacter(276) - Out of room on texture map!
CFontMap::AddCharacter(277) - Out of room on texture map!
<cut>
CFontMap::AddCharacter(590) - Out of room on texture map!
CFontMap::AddCharacter(591) - Out of room on texture map!

BaronJames
08-25-2009, 12:56 AM
日本語テスト

kadeve
08-27-2009, 07:44 PM
will someone fix this thing?? should i start spam posting

IAmRoot
08-27-2009, 09:03 PM
kadeve, I need all your files. Pack them up in a resouces#.s2z and post them.

kadeve
08-28-2009, 08:57 AM
http://www.mediafire.com/?sharekey=ae0a0c64139a3070d6baebe61b361f7ce04e75f6 e8ebb871

my core file and my fonts.. the problem is not about translation files cuz im using the english ones.. we cant use turkish chars (8 chars 4 upper 4 lowercase)

in irc chat and IM all missing
in console i can see all but Ğ ğ

during game again Ğğ also i think 1 more missing

Stiv1
08-28-2009, 08:59 AM
I have the same mistake, after manual update from 1.38.0 to 1.40.0. (After automatic update i had a K2 error).
CFontMap::AddCharacter(276) - Out of room on texture map!
CFontMap::AddCharacter(277) - Out of room on texture map!
<cut>
CFontMap::AddCharacter(590) - Out of room on texture map!
CFontMap::AddCharacter(591) - Out of room on texture map!

WinXP, 32bit, SP3.

kadeve
08-30-2009, 07:12 AM
any updates about this ??

did some research and I found that Turkish is the 5th most spokem language in the world

1-Chinese
2-English
3-Spanish
4-Urdu
5-Turkish

ArmedMonkey
10-24-2009, 12:21 PM
I may be misunderstanding this post, so at the risk of sounding stupid...

How do I get my regular english version to display cyrillic characters? I don't want a full translation, just to be able to see the text.

gerbercage
10-25-2009, 07:59 AM
No more Chinese translation for this game? I just found out in Main menu no more Chinese flag, is that mean S2 not going to translate it into Chinese?

thelonelyone
12-16-2009, 06:49 AM
hi, i'm from vietnam, i need some character for my vietnamese:
Combining Diacritical Marks (http://www.alanwood.net/unicode/combining_diacritical_marks.html), Latin Extended Additional and (http://www.alanwood.net/unicode/latin_extended_additional.html)Private Use Area (http://www.alanwood.net/unicode/private_use_area.html)

Can you Include these in next patch?

tomas666
12-17-2009, 11:11 AM
and what about support of the czech characters? for example these
ěĚčČřŘůŮ and some other
devs promised it several months ago :/
without this, the czech translation (one of the few translations that are updated every patch) will never be complete...

evotech
12-17-2009, 02:55 PM
Is there any way not to see boxes with the english version of the game?

IAmRoot
12-17-2009, 10:36 PM
Is there any way not to see boxes with the english version of the game?

You can modify the english resources file to include a broader range of characters.

Elman1
12-26-2009, 06:41 AM
لا اله الا الله محمد رسول الله

song_tinh
03-28-2010, 03:45 AM
S2, Please add Latin Extended Additional on Heroes Of Newerth Client, I can't fix or translate language to Vietnamese. I will use FreeSans font for client

tomas666
03-28-2010, 01:17 PM
i believe i found a solution - at least for some translations.
in core_xx.resources, modify all occurrences of "<fontface file="[some_font]">".
list of all built-in fonts can be found in "resources0.s2z/core/fonts". replace [some_font] with one of these fonts. for czech translation, it worked when i changed it to "<fontface file="/core/fonts/game_ru.ttf">".
try this, i think it should work for more languages than just czech...

Baiocco
10-10-2010, 07:38 AM
why not translate in italian??

Karnak
10-11-2010, 12:45 PM
there is Italian translation in progress, try to search first, you can help, talk with them.
http://forums.heroesofnewerth.com/showthread.php?t=5337

they also translated some heroes voice, very cool :D

MalKo
05-31-2011, 12:29 PM
:temp:

c0de_Geass
12-27-2011, 12:36 PM
u-f ??

Goosig
01-23-2012, 07:19 AM
jag gillart

mokoko53
02-04-2013, 08:46 AM
Hi,

Included in next patch (1.34):
latin (range extended to 0000 to 024f, now includes "Latin Extended-A" and "Latin-Extended-B")
greek
cyrillic (extended range to include "Cyrillic Supplement")
armenian
hebrew
arabic
devangari
bengali
gurmukhi
gujarati
thai
hangul_jamo
tagalog
mongolian
hiragana
katakana
cjk
hangul_syllable

"Latin Extended-A" includes Turkish words but In-game it doesn't work. I translated Accursed's history and skills. But when I check in-game, some Turkish words like "ğ,ş,ü,ı,ç" are missing. There is a picture below.


http://i1139.photobucket.com/albums/n552/RawsLy/honforum_zps89d8c4f3.png
http://i1139.photobucket.com/albums/n552/RawsLy/honforum2_zps125579e2.png