QCATS: Query Context-Aware Transformer Slicing for Efficient Predictive Query Processing
QCATS slices transformer FFNs using query predicates, cutting in-database inference latency up to 4.42x.
40
QCATS slices transformer FFNs using query predicates, cutting in-database inference latency up to 4.42x.
Today 718 readers · 849 views · 277 reads · all time 187K views