I really don't see anything terrible with your stat allocations or skill point allocations. the one thing I disagree with is putting points into a cross class skill that requires 2 points for 1 point of umd. by level 20, you wont have the umd for anything really useful at your current pace and you made Charisma as a dump stat. your Intelligence is high and you don't appear to be a Stalwart Defender. 13 Int is required for Combat Expertise. I assume you put more points in Int for extra skill points? base will only get you 1 point, but I would lower it and put the extra points into Charisma if you want better umd. otherwise, for a fighter, balance, intimidate, even number for tumble and that's it and heal are the most important ones.
I see that you are dwarf. there is a dwarf enhancement Throw Your Weight Around, top tier, that uses con for damage instead of strength. you could also lower your str down a few points and invest in con if you prefer to use that stat instead.
these suggestions are based on if you are going pure. the build itself isn't terrible with just a few things to change if you are not willing to re-roll. you could spend the lesser now if you want. it is yours and can do as you please, but if if you do re-roll/lesser I would suggest the stat changes I said earlier. you could also go at minimum 2 Rogue, but its always better to do that at level 1 when you have the most skill points to spend. that way you can evade some damage and its easier to get better umd since its not a cross class skill for rogues.
other than that, I get the feeling the other part of your problem is just experience. it will come with time and if elite is too much for you, there is always hard and normal until you get better at the game.