Trim ring - valve hole
 

I am having issues with my trim rings wanting to slice thru my valve stems.
I just need a fraction of an inch shaved off the inside of the hole. Any recommendations on what to use to cut or file it without damaging the adjacent finish.

Step drill bit would be my first thought.

I have used RTV clear sealant on hubcaps and trim rings to keep them in place.