Fisher was born in Milford on Sea, Hampshire, England, the daughter of American parents Olga Rosine (née Moen), a housewife, and William Irving "Bill" Fisher, Sr, an oil refinery construction superintendent. Her father was of Russian Jewish and Hungarian Jewish descent, while her mother was of Norwegian ancestry.  Before she reached the age of fifteen, she had moved nine times and travelled because of her father's job, going to places including Italy, Turkey, Colombia, France, Canada, and Brazil. When she was 15, her mother died and she took on the responsibility to help raise her younger brother. She ultimately completed her high school at Lutcher Stark High School in Orange, Texas, where she performed in theatre productions, and later worked as a secretary.