Avoiding a government shutdown is also at the top of the agenda, alongside dodging a catastrophic credit default, which may be the largest of the looming deadlines
"Right now it's month-end rebalancing," said Ian Lyngen, head of US rates strategy at BMO Capital Markets in New York, noting the next major market catalyst will be next Friday's jobs report for April.
The yields fell back down in the afternoon, however, and are now trading in the middle of their recent range.
A short burst of selling on Thursday morning was also seen with a brief spike in trading volumes in long-dated Treasury futures, while the five-year, 30-year Treasury yield curve steepened relatively sharply.
Biden is having to push Congress for funding while simultaneously getting his government confirmed -- Pentagon chief Lloyd Austin won Senate approval Friday -- and bracing for turmoil from Trump's impeachment trial.
Executives of state-owned enterprises, officials of the Chinese Communist Party and military, along with oil giant CNOOC will face new restrictions for allegedly using coercion against states with rival South China Sea claims.