Switch lexer to byte based scanning

[Lurk]

No description provided.

[codecov]

Codecov Report

❌ Patch coverage is 95.68627% with 11 lines in your changes missing coverage. Please review.
✅ Project coverage is 99.4%. Comparing base (5fbf890) to head (e7d23f0).

Files with missing lines	Patch %	Lines
src/lexer/mod.rs	94.3%	11 Missing ⚠️

Additional details and impacted files

Files with missing lines	Coverage Δ
src/lexer/token.rs	100.0% <100.0%> (ø)
src/op/anchor.rs	100.0% <100.0%> (ø)
src/op/bold.rs	100.0% <100.0%> (ø)
src/op/code.rs	100.0% <100.0%> (ø)
src/op/code_span.rs	100.0% <100.0%> (ø)
src/op/collapsible.rs	100.0% <100.0%> (ø)
src/op/embed.rs	100.0% <100.0%> (ø)
src/op/emphasis.rs	100.0% <100.0%> (ø)
src/op/heading.rs	100.0% <100.0%> (ø)
src/op/highlight.rs	100.0% <100.0%> (ø)
... and 10 more

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[github-actions]

Benchmark for cf15c47

Click to view benchmark

Test	Base	PR	%
ast/small yamd document	1402.1±27.73ns	1377.4±41.51ns	-1.76%
ast/~344kb of YAMD written by humman	631.7±6.01µs	628.9±7.80µs	-0.44%
ast/~344kb with high density of tokens	2.3±0.02ms	2.3±0.02ms	0.00%
ast/~346kb with low density of tokens	54.5±2.35µs	49.3±0.72µs	-9.54%
lexer/small yamd document	2.9±0.03µs	600.7±8.00ns	-79.29%
lexer/~344kb of YAMD written by humman	3.5±0.10ms	484.0±8.46µs	-86.17%
lexer/~344kb with high density of tokens	5.8±0.01ms	2.5±0.03ms	-56.90%
lexer/~346kb with low density of tokens	920.7±47.78µs	305.6±5.05µs	-66.81%
parser/small yamd document	4.1±0.04µs	1813.0±15.63ns	-55.78%
parser/~344kb of YAMD written by humman	3.9±0.12ms	981.2±10.55µs	-74.84%
parser/~344kb with high density of tokens	9.8±0.04ms	6.7±0.06ms	-31.63%
parser/~346kb with low density of tokens	998.9±56.74µs	391.6±4.26µs	-60.80%
roundtrip/small yamd document	11.3±0.21µs	9.1±0.14µs	-19.47%
roundtrip/~344kb of YAMD written by humman	9.0±0.13ms	6.1±0.07ms	-32.22%
roundtrip/~344kb with high density of tokens	23.6±0.25ms	20.5±0.17ms	-13.14%
roundtrip/~346kb with low density of tokens	3.4±0.07ms	2.8±0.03ms	-17.65%