wbrawner/hoedown
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Merge pull request #130 from MarkLodato/utf8-tab-expansion

Browse source 
Make tab expansion UTF-8 aware.
This commit is contained in:
Devin Torres 2014-10-04 16:56:22 -05:00
commit 4e1b16cfab
1 changed files with 10 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

11
src/document.c
View file

@ -2671,13 +2671,22 @@ is_ref(const uint8_t *data, size_t beg, size_t end, size_t *last, struct link_re
static void expand_tabs(hoedown_buffer *ob, const uint8_t *line, size_t size)
{
/* This code makes two assumptions:
* - Input is valid UTF-8. (Any byte with top two bits 10 is skipped,
* whether or not it is a valid UTF-8 continuation byte.)
* - Input contains no combining characters. (Combining characters
* should be skipped but are not.)
*/
size_t i = 0, tab = 0;
while (i < size) {
size_t org = i;
while (i < size && line[i] != '\t') {
i++; tab++;
i++;
/* ignore UTF-8 continuation bytes */
if ((line[i] & 0xc0) != 0x80)
tab++;
}
if (i > org)