Knowledge Distillation Shrinks Models Without Losing Much
A large model can teach a small one to nearly match it. Knowledge distillation trains a compact 'student' to mimic...
A large model can teach a small one to nearly match it. Knowledge distillation trains a compact 'student' to mimic...
Some networks abruptly generalize long after they seem done learning. Researchers observed 'grokking,' where a model masters a task suddenly...
A clever trick makes big language models generate text faster without changing output. A small draft model proposes several tokens...
Microscopic animals that endure the harshest conditions are giving up their secrets. Tardigrades survive drying, freezing, and radiation by entering...
Printers that deposit living cells are constructing functional tissue. Bioprinting lays down cells and scaffolds in precise 3D patterns. Researchers...
Scientists mapped a cubic millimeter of mouse brain in extraordinary detail. The reconstruction traced hundreds of thousands of cells and...
A powerful new solar telescope resolved features on the Sun smaller than ever seen. Its first images showed cell-like structures...
Tiny devices lined with living cells mimic the function of human organs. Organs-on-chips recreate the flow and forces of real...
Ultra-thin engineered surfaces can replace bulky lenses. Metasurfaces studded with nanoscale structures steer light with precision in a flat film....
Viruses tailored to kill specific bacteria saved patients when antibiotics failed. Engineered bacteriophages cleared drug-resistant infections in compassionate-use cases. The...