Nathan, I'm not 100% sure whether yr describing the front end tucking under (falling in) or washing out, but I think you mean tucking under.
My maths/physics teacher always used to say, "work it out from 1st principles", so here's a go (as I understand it):
As you turn the bars, you lose trail till it becomes zero then goes negative (ie lead not trail).
When you lean, it also brings into play the effect of the bike's C of G & the mass of the forks etc in front of steering centre-line (pendulum effect). Both those gravity forces work to overcome the self-centring effect of trail when you turn & lean.
That's why the wheel flops to the side when you put the bike on the side stand. Its the same effect as tucking under in turns.
The usual fix is more trail, usually via more rake & as you know there's several ways to do that - push the forks thro triples, softer rear, sit further back (a trade off w losing front grip tho of course), gas it more etc, mentioned above. Even tyre pressures can make a diff.
However one of the 1st things I'd be checking is if you can mount the big lights closer to the steering axis. As is, that extra pendulum effect will be overcoming the self-centring effect sooner as you turn & lean, making the tucking-under worse (happen sooner). Be mindful of the centre of gravity too.
Why does it happen in soft ground/sand & not on hard track? 2 things: as the tire sinks more under weight transfer in cornering, the effective dia becomes smaller so trail is less, but also, the contact area is considerably longer having another (perhaps larger) effect on shortening trail & reducing the self-centring effect. (Too-low front tire pressure has similar effect.)
Thats why its usually a good policy to sit back further & keep the power on in sand