E (minor or major) really push the harmony hard into A (minor or major) as it could be considered as a 5th grade.
It is hard to make this smoother, because it really wants to resolve on A, it depends how many beats you have to fill between the two, but you can use Aflat diminished, you can go...