I ordered all of my stuff from the links here however the power supply linked is no longer available.  It has specs of 5V 10A 50W.  The one I went with is 5V 8A 40W.  The LEDs show 0.3w per so that is only 30w assuming all are lit.  I probably only have 60 on. The RPI looks like it only uses a max of 5.1W.  Seems like I should have plenty of power

Sounds easy enough to power the LEDs on both sides if needed.  

I’m thinking and hoping this is a fried converter from all of my multiple moving things around.

I agree, you have enough wattage. I hope you are right and the level converter is messing you up. Because you've got a clean setup up from what I can see. Let us know. - Mark

I put together a new board with a new converter and all soldered connections.  Seems like I have it mostly working correctly now.  Only issue I am having is a have to hold the lead that goes from the level converter to the Pi very firmly on the Pi side or I get random flashes and color changes.  If I hold it with my hand firmly it runs fine.  I have soldered a new lead to the board but am still having same problem.  Any ideas on keeping this firmly in place on the Pi?  Don't think its a good idea to solder.

This may be too simple, but are you using the proper jumper wires, or could you be using some that have been stretched to wide? Here's an example of what I'm referring to; https://www.amazon.com/Elegoo-EL-CP-004-Multicolored-Breadboard-arduino/dp/B01EV70C78/ref=sr_1_2_sspa?dchild=1&keywords=rpi+jumper+wires&qid=1615946874&sr=8-2-spons&psc=1&spLa=ZW5jcnlwdGVkUXVhbGlmaWVyPUExOFBOTkpCWkNZREROJmVuY3J5cHRlZElkPUEwMDIzNzkyM1IxTktGUUVYUkpCMSZlbmNyeXB0ZWRBZElkPUEwOTQ1MzIxMUVLUFZPSjk1OTFYOSZ3aWRnZXROYW1lPXNwX2F0ZiZhY3Rpb249Y2xpY2tSZWRpcmVjdCZkb05vdExvZ0NsaWNrPXRydWU=

I agree that if you don't have to, don't solder to the RPI just so its easier to reuse later. But a good tight connector will be necessary. Sounds like you are real close. Good job. - Mark

I have the exact wires you linked above.  I’ve tried three different ones and they all require holding the connection firmly to keep the map working properly.

Then I'd reflow the solder on the pin on the rpi. Could be that there is a cold solder there causing the issue.  - Mark