If you are trying to delete an EC2 security group and get an error something like:
sg-12345678: Group 111222333444:My SG Name is used by groups: 123412341234:elmo.ec2sg.887766
Save yourself some time and check that your ElastiCache and RDS security groups don't reference (by name) the group you are trying to delete. See this forum thread.