You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
liwenxuan
5141388245
|
2 years ago | |
|---|---|---|
| .. | ||
| LICENSE | 2 years ago | |
| README.md | 2 years ago | |
| index.d.ts | 2 years ago | |
| index.js | 2 years ago | |
| package.json | 2 years ago | |
README.md
js-tokens
The tiny, regex powered, lenient, almost spec-compliant JavaScript tokenizer that never fails.
const jsTokens = require("js-tokens");
const jsString = 'JSON.stringify({k:3.14**2}, null /*replacer*/, "\\t")';
Array.from(jsTokens(jsString), (token) => token.value).join("|");
// JSON|.|stringify|(|{|k|:|3.14|**|2|}|,| |null| |/*replacer*/|,| |"\t"|)