My advice would be to test the 5.3 against a 12x10 in left/right separation via masking targets with nails in various ways. I've done that, filmed on video for youtube, and shockingly my DD trash coil on my machine didn't appear to have nearly as good left/right separation as the 12x10 DD in several tests. That impressed the heck out of me, and I always suspected the 12x10 had a super tight DD detection line width.
Outstanding coil in both depth and separation and stability, but I'm not using your machine so no way to say that would be true for you. I'm confident if I grid a site from several angles there isn't much the 12x10 will miss masking wise, but of course a small coil, even one with seemingly not as good left/right separation, will have the advantage in terms of length wise separation. That's why it's important to grid from several angles IMO, regardless of how big or small the coil is.
Another thing that surprised me is that the old rule of thumb of a smaller coil seeing through mineralization better didn't seem to apply in my case. I did a test using 3 mineralized bricks, testing 4 coils as I did them also on various nail masking tests in the video, and found my trash coil didn't *appear* to handle the mineralization as well.
Of course these were all air tests, so the results are in no way a sure thing in actual in ground conditions, but just the same I found it highly interesting.
Since you already have a 6x8, which is a very good trash coil, I'd shoot for a larger coil for more potential depth. Then again, I'm a big fan of the smallest round DD coil for a trash coil as well for max separation. I love the shape of the 12x10 in a large coil to attempt to improve left/right separation while still gaining depth, but in terms of a trash coil I just want round for max unmasking potential. Depth to me is secondary in a trash coil. Not what I want one for.