@Jak Angelescu and
@Ed Seith took me a while to get it down but your tips helped me a lot! I actually believe it wasn't the top strings ringing out but my picking hand palm creating a harmonic-ish sound when playing. But I could correct that by adjusting my fretting hand like you guys suggested.