Another good solution, considering you seem to be producing these in reasonable quantity, is to use either intensifiers or a pre-formed vacuum bag, both of which you would make from silicone. The intensifier is along the same lines as what you attempted with the rubber grommet, but formed to fit your part perfectly and apply pressure in exactly the right places without shifting under vacuum.