MOAI speeds non-interactive homomorphic transformer inference
It cuts BERT-base evaluation time 52.8% versus THOR and reports 2.36 minutes amortized per input on one GPU.
26 stories, newest first · one card per story
It cuts BERT-base evaluation time 52.8% versus THOR and reports 2.36 minutes amortized per input on one GPU.
On 192 threads it restores 1 to 9 levels for 4096 messages in 46 to 83.4 ms, up to 3 times faster than SHIP.
The authors select parameters and show feasibility with a proof-of-concept aimed at an embedded use case.
In a matched 100-update run, device-resident bootstrapping cut training from 14,268.295 to 293.075 seconds with equal decoded parameters.
On BIGANN SIFT1B it reports recall@100 of 0.9715; 100 million vectors take 3.735 seconds on one GPU.
Perseus is 3.96x faster than other FHE implementations for Llama-3-8B
The design transforms 2^16 coefficients every 5.12 μs at 400 MHz and accelerates FHE by 1.8-2.2x.
Encrypted queries reduce to one matrix-vector multiply, without FHE bootstrapping, interaction, or a client index.
The scheme packs k symbols into a length-n ciphertext and claims bounded chosen-plaintext security.

On about 21,800 recordings, encryption overhead ran from roughly 30% to 1,200% while accuracy stayed near 97% to 99.9%.
AutoPoly-HE automatically designs polynomial activations for encrypted inference across ResNet and Vision Transformer models.
Zeppelin brings BFV encryption and decryption to Arm Helium microcontrollers, encrypting 4096 values in 4.76 ms.
HE-OFT fine-tunes models once under multiparty CKKS so no participant receives the trained model.
FBAN enables TFHE-based continuous authentication from touch behavior at 128-bit security.
Framework achieves first constant-rate certified deletion in the plain model across BB84-style and coset-state primitives, cutting qubit overhead per encrypted bit.
A federated-learning design combines homomorphic encryption and differential privacy, beating DP-only utility and privacy on FEMNIST.
HE-Guardrail detects LLM jailbreaks during encrypted inference without decrypting client prompts.
A batched GPU Paillier client computes Hamming distance on encrypted 512-bit embeddings at high throughput.
Researchers propose SEEK, a homomorphic-encryption plus 2PC protocol for encrypted keyword search that hides keywords while detecting matches.
ROSETTA is a hybrid CKKS/TFHE homomorphic encryption framework for privacy-preserving LLM decoding, achieving up to 4.8x Softmax and 2.1x end-to-end speedups.
OptiPrime co-designs HE-MPC protocols with hardware acceleration to remove network communication bottlenecks in private DNN inference, beating Cheetah by up to 5.7x.
Federated learning framework combining dynamic differential privacy, homomorphic encryption, and local DP retains 82.6% accuracy at epsilon 0.1 while cutting communication 21.3%.
Interleaved subgroup packing cuts PASTA homomorphic transciphering server cost by a median 1.60x at the expense of remaining noise capacity.
Odin runs Llama-3-8B fully homomorphic encrypted inference on a single H100 in 366 seconds, a 4.51x speedup over THOR.
Today 1.5K readers · 2.4K views · 754 reads · all time 189K views