balance rq-kmeans

[bruceyang2012]

It seems that rq kmeans doesn't use the balance method. Can this be open-sourced?

[pepsi2222]

It was open-sourced in https://github.com/Kuaishou-OneRec/OpenOneRec/tree/main/tokenizer

[bruceyang2012]

It was open-sourced in https://github.com/Kuaishou-OneRec/OpenOneRec/tree/main/tokenizer

This appears to be the original rq-kmeans without the balance strategy added.

[jp-guo]

Hi, I’m confused why this issue was closed before the actual question was answered.

[zjuyang]

Hi, I’m confused why this issue was closed before the actual question was answered.

[HonghuiBao2000]

@zjuyang

Could you show where the balance is mentioned?

[zjuyang]

@zjuyang

Could you show where the balance is mentioned?

https://arxiv.org/abs/2502.18965

[HonghuiBao2000]

@zjuyang

Hii, we are using our own open-source tokenizer, which is the same tokenizer released in our repository.