Should I be worried?

doogie, I still think it may be a little too soon to tell if there's a issue? If it runs fine, no noise, and the pressure hasn't changed a bit since startup, I'd run the new oil for a bit and see how that looks? If by chance it's going bad, it will need some further machining anyway, so I personally wouldn't have a issue running it a little more to see what you get? I've seen a few odd oil changes in my day, and it's normal to get a little paranoid with a new build.......lord knows I was that way for most of mine.....lol.

xxs2 .. there coulda been a small pocket of crap that got flushed out at start-up,, not uncommon alltho undesireable.. stuff happens..

hope it helps....