Skip to main content

Alibaba's ZeroSearch Teaches AI To Search Without Search Engines, Cuts Training Costs By 88%

1 month 2 weeks ago
Alibaba Group researchers have developed "ZeroSearch," a technique that enables large language models to acquire search capabilities without using external search engines during training. The approach transforms LLMs into retrieval modules through supervised fine-tuning and employs a "curriculum-based rollout strategy" that gradually degrades generated document quality. In tests across seven question-answering datasets, ZeroSearch matched or exceeded the performance [PDF] of models trained with real search engines. A 7B-parameter retrieval module achieved results comparable to Google Search, while a 14B-parameter version outperformed it. The cost savings are substantial: training with 64,000 search queries using Google Search via SerpAPI would cost approximately $586.70, compared to just $70.80 using a 14B-parameter simulation LLM on four A100 GPUs -- an 88% reduction. The technique works with multiple model families including Qwen-2.5 and LLaMA-3.2. Researchers have released their code, datasets, and pre-trained models on GitHub and Hugging Face, potentially lowering barriers to entry for smaller AI companies developing sophisticated assistants.

Read more of this story at Slashdot.

msmash

Trump To End Biden-Era High-Speed Internet Program

1 month 2 weeks ago
President Trump on Thursday attacked a law signed by President Joe Biden aimed at expanding high-speed internet access, calling the effort "racist" and "totally unconstitutional" and threatening to end it "immediately." The New York TimesL: Mr. Trump's statement was one of the starkest examples yet of his slash-and-burn approach to dismantling the legacy of his immediate predecessor in this term in office. The Digital Equity Act, a little-known effort to improve high-speed internet access in communities with poor access, was tucked into the $1 trillion bipartisan infrastructure bill that Mr. Biden signed into law early in his presidency. The act was written to help many different groups, including veterans, older people and disabled and rural communities. But Mr. Trump, using the incendiary language that has been a trademark of his political career, denounced the law on Thursday for also seeking to improve internet access for ethnic and racial minorities, raging in a social media post that it amounted to providing "woke handouts based on race."

Read more of this story at Slashdot.

msmash