Run this MYSQL:
SHOW STATUS LIKE 'threads_connected';
Run this on production to see how many connections on average are used on your production database.
Then run this on your box where you're testing load with jmeter to help you match the same amount of activity in your load test.