I actually somewhat managed to work out what was going on with my laptop after reading more about UEFI and coming back to it after... whenever the last post I made in this thread was.
I'm still not sure why my laptop tends to not boot Clover UEFI normally, but I have been able to kinda force it to.
Whenever installing a UEFI OS (Like Ubuntu in my case), it adds its own boot option to the UEFI Boot List. In Ubuntu's case it's /EFI/ubuntu/shimx64.efi. And in the Latitude E6410 BIOS it lets you view the boot option and see what it's listed as.
So I looked at it the boot entry in my BIOS, and it said the filesystem it was looking at was HD(1,GPT, Then my drive's UUID), then it told me the path to the EFI file (/EFI/ubuntu/shimx64.efi). Okay, so I'll try to add my own boot option to see if I can make it boot Ubuntu myself to get a grip on what's happening. I add the option, and I pick my HDD from the list (it doesn't let you type it in yourself), and it fails to boot.
Now, what happened? Well, apparently when you add your own UEFI option in the BIOS, it adds the filesystem string incorrectly, causing any manual configuration to fail. So, good job Dell...
Then, I realized, the BIOS sees shimx64.efi. I'll just rename Clover's BOOTX64.efi to shimx64.efi and put it in the same place. And it worked, then I used the Ubuntu boot option to load Clover and added Clover as a boot option. It added the proper CLOVERX64.efi boot entry to my BIOS. So, now I have some working ground.
Then I was just gonna load the UEFI Shell from Clover and manually configure my UEFI options because why not? Well, Clover was acting a little strange and UEFI Shell wouldn't load. So I tried to load OS X from my flash drive, and that just failed all together, it didn't even bring up the OS X boot logo and my flash drive access indicator wasn't flickering. That makes me assume something is wrong and it's not even trying to load anything properly.
So, that's where I'm stuck, I got Clover to load finally, but I can't get Clover to load OS X. This isn't really a request for help, just a note to others with an E6410 who would like to try to get OS X loading through UEFI themselves.
Also, thanks to Bronxteck for trying to help me last month.