Reference: https://arxiv.org/abs/2504.19874
Ran on a subset of scifact (50 queries, 500 docs)
=== Evaluation summary ===
Queries evaluated: 50
TQ Hit@1: 0.7000
TQ Recall@5: 0.8200
RAW Hit@1: 0.7200
RAW Recall@5: 0.8200
TQ MRR: 0.7435
Bits: {'original_bits': 4096, 'mse_bits': 768, 'qjl_bits': 128, 'norm_bits': 32, 'total_bits': 928, 'compression_ratio': 4.41}
- run
save_data.py, theneval.py