Should I be worried?

I've never seen the silvery oil you got there. However, small debris shown on fingers I have had over the years especially after a new build. Never experienced silvery oil.

Here's what I'd do:

Cut open oil filter and see what it trapped. Full of metal-bad news; gunky silvery stuff-sample and lab it; mostly clean inside-new filter, oil and fire it up! Run 5-10 minutes and check...if oil looks good-drive it! If you have a mechanics stethoscope ( or long screwdriver), listen with it during those 5-10 mins for noise in most probable areas. Check oil again after 20, no more than 100 miles.

Also, did the silvery oil separate over night? Might change temperature to see if it will separate (try colder first, then hotter). Would be good to get a good sample of it sent off...got my fingers crossed for you!