🔄 refactor: Consolidate Tokenizer; Fix Jest Open Handles (#5175)

* refactor: consolidate tokenizer to singleton

* fix: remove legacy tokenizer code, add Tokenizer singleton tests

* ci: fix jest open handles
This commit is contained in:
Danny Avila 2025-01-03 18:11:14 -05:00 committed by GitHub
parent bf0a84e45a
commit c26b54c74d
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
11 changed files with 202 additions and 221 deletions

View file

@ -59,6 +59,6 @@ class Tokenizer {
}
}
const tokenizerService = new Tokenizer();
const TokenizerSingleton = new Tokenizer();
module.exports = tokenizerService;
module.exports = TokenizerSingleton;