It was in fact the heat shield. I went to Pep Boys to get an under car inspection and the mechanic spotted it immediately and fixed it for me. Didn’t charge me more than the inspection itself, which was roughly 20 dollars.
Thanks for the help! Now I am driving rattle-free!