Every national budget is, by origin, a small leather bag.
The trail starts with the Gauls. The Romans borrowed their word bulga, a leather pouch or knapsack, and Word Histories links it to Irish bolg and Welsh bol, "belly." In French, bulga became bouge, a bag, with the diminutive bougette. Randle Cotgrave's French-English dictionary of 1611 defined bougette in part as "a little male, pouch, or budget."
English borrowed the word in the early 1400s for a pouch or wallet, usually of leather. A pedlar could carry "a budget of small wares," as Thomas Coryate wrote in 1611. By the late 1500s the word also meant what was inside the bag, especially a bundle of papers or news. Jonathan Swift wrote of "the whole budget of papers" in 1729.
The money sense was born as a joke. In 1733 Sir Robert Walpole proposed shifting taxes from land to goods, setting off the Excise Crisis. A pamphlet titled The Budget Opened answered him. Word Histories credits it to his rival William Pulteney. It cast the minister as a quack opening a wallet of remedies and tricks. "To open one's budget" was already an idiom for speaking one's mind, which sharpened the jab.
The satire lost the long game. Politicians adopted the word, and by the 1760s "budget" was the settled name for a government's yearly plan of revenue and spending. Horace Walpole recorded in 1776 that "Lord North opened the Budget." The word reached household finances in the 1850s, became a verb in the 1880s, and came to mean "cheap" in 1958.
French then borrowed its own word back. It began using budget for British public finances as early as the 1760s. Word Histories calls it a boomerang word: it left France as bougette and came home as a set of public accounts.
The container has not entirely disappeared. World Wide Words points to the Chancellor of the Exchequer holding up the red despatch box with the budget speech on the steps of 11 Downing Street. The bag became a box, but the ritual of opening it survives.