I feel for you. I started Cub Scouts over 40 years ago. In those days, we had Den Mothers. Fathers led the Boy Scout troops. Scouting was popular, and we would wear our uniforms to school on special days. At the time I lived in the South Bay area of Calif. Campouts were always in someone's back yard. I opted out of continuing to Boy Scouts as I was more interested in sports. Additionally, I got into backpacking in high school, and my adventures really but the local Boy Scout troop to shame. I think part of this is that I lived in suburbia. I know it is different in rural areas, as I would often run into groups of scouts in the southern Sierras where I was cutting my young teeth on the BPing fever in the 1960's.
Fast forward to the early 90's. I got my son and daughter into scouting. Unfortunately, scouting was no longer popular and in Palm Springs and Orange County where the kids joined troops. Scouts were regarded as nerds. Although both kids were popular in school, luckily (or good parenting?) they could care less what their friends thought about Scouting. But both of them were really bored with the silly activities that took up most of the time. Both of them enjoyed camping and hiking with the other kids, other than the fact they had been doing this at a "higher" level with me since they were babies.
As far a backpacking, don't hold you hopes too high. When Joe was 7 - 9 years old, one of his favorite things to do was to BP with me in the San Jacintos, so he could blow by all the older Boy Scouts on the trail to the summit of San Jacinto. Since you live in So Calif, I am afraid it will be similar. If you lived in Moab, UT or Bozeman, Mt it is probably a lot differnt.
If your kids enjoy Scouting, then stay with it. If they don't like it, then let them pass. Since I know you do a lot of camping and BPing with the family, this family activity is much better for building character. Our family camped a lot together. The long vacations with just the family helped us bond together and keep the communication always flowing between us and the kids. I never had a single discipline problem with either kid. They were honor students and participated in activities to the point that it was a full time job to go to all their practices and competitions. Joe was a nationally recognized elite distance runner in High School, and Nicole was in Cheerleading and Dance. Nicole graduated from college last year and Joe will do the same this spring. In my mind, their success in life at this point in time, is rooted in the quality time we spent as a family on the trail and in campgrounds. Nicole is not interested in BPing, but she still likes to ocassionally go camping with me. Joe does BP.