Swannanoa Palace: The Marble Villa Above Rockfish Gap

Reviewed by Josh N · Updated October 7, 2026 · How we verify

Swannanoa Palace stands on the crest of the Blue Ridge in Virginia, above Rockfish Gap, a marble Italian Renaissance Revival villa built in 1912 by the Richmond millionaire and philanthropist James H. Dooley as a gift for his wife. It was meant to be a summer place. It was lived in for only a few years, then spent most of the following century as something else: a country club, an empty shell, a near miss for a wartime interrogation center, and the headquarters of a mystical philosophy school. That strange, discontinuous occupancy is the real foundation of the ghost stories told about the house, and it is worth laying out before any of them.

Quick Orientation

• Built 1912 for James H. Dooley (1841 to 1922) and his wife Sarah “Sallie” O. May Dooley
• Sits on a jurisdictional line, so the property lies in both Augusta and Nelson counties
• Rockfish Gap below it is the southern end of Skyline Drive through Shenandoah National Park and the northern terminus of the Blue Ridge Parkway
• Partly based on buildings in the Villa Medici and the Villa Borghese in Rome
• Operated since 2007 by Skyline Swannanoa, Inc. as a private venue, available by private booking or ticketed events

The House Dooley Built for Sallie

Swannanoa was a token of love, and the building does not understate the point. The depth of the Dooleys’ marriage is written into the architecture: a Tiffany stained glass window made of 4,000 pieces, and a domed ceiling bearing the likeness of Mrs. Dooley herself. Reportedly more than 300 artisans speaking different languages worked inside for several years to finish it, using marble from Tate, Georgia alongside Italian marble, and laying out terraced gardens on the mountainside.

The technology was as lavish as the stonework. The house had electricity, plumbing and central heat when those were still luxuries in rural Virginia. It was the first house in Nelson County to have electricity, and to manage that it ran its own power plant on the property. There was a built-in elevator. Like Monticello, Thomas Jefferson’s house 27 miles away, it had a dumbwaiter that carried food up from the basement kitchen to the butler’s pantry on the first floor.

Despite all of that expenditure, the villa was occupied for only a few years after its completion. Major Dooley died in 1922 at the age of 82, leaving Swannanoa and several million dollars entirely to Sallie. She died in 1925 at the age of 79, and the estate passed to Major Dooley’s sisters. Much of the Swannanoa furniture went to Maymont in Richmond after her death, where her swan furniture and bed are still on display. A house emptied of its owners and then of its furniture within three years is a useful fact to hold onto when reading the later accounts of footsteps and voices in it.

Golf, Moonshine and the Coolidge Thanksgiving

The sisters sold Swannanoa in 1926 to the Valley Corporation of Richmond, which opened the Swannanoa Country Club and Golf Course in 1927 around an 18-hole course. During that era a small stone building went up for guests to pay their golf fees, and it was rumored to house the region’s best moonshine distillery and to supply government officials during Prohibition. Rumor is the correct word there, and the source for it is no more solid than clubhouse talk.

What is on the record is the guest list. President Calvin Coolidge took Thanksgiving dinner at the mansion in 1928. The accommodations and the distance from Washington’s noise reportedly left Mrs. Coolidge in high spirits, described by the waitstaff as having “the giddiness of a mare in the spring,” while the president said little and looked drawn and sleepy at the next day’s hunting.

The 1929 Depression killed the club’s revenue, and the Dooley sisters took the property back in 1932. In 1942 the United States Navy looked at buying and renovating Swannanoa, at a calculated cost of $200,000, as a secret facility for interrogating prisoners of war. The military passed, choosing a Civilian Conservation Corps camp at Fort Hunt, Virginia instead, on the reasoning that Congress was unlikely to approve the purchase of so palatial a structure. The mansion sat empty through the Depression and the Second World War.

Walter Russell’s Fifty-Year Lease

A. T. Dulaney bought the villa with a group of Charlottesville businessmen in 1944 and formed Skyline Swannanoa, Inc. Four years later, in 1948, the house was leased for 50 years to Walter Russell for his University of Science and Philosophy. That half century of occupation by a mystical teaching organization is the origin of the “occult” element that attaches to Swannanoa in popular retellings, and it is the single most misdescribed chapter of the house’s past.

When the lease ran out in 1998, James Fillmore Dulaney and his wife Sandi Dulaney lived at Swannanoa and oversaw a three million dollar external restoration completed between 1999 and 2006.

What Visitors Say They Experience at Swannanoa

None of what follows is documented. These are reported experiences, passed along by visitors, investigators and tour groups, and they should be read as folklore attached to the building rather than as events with a paper trail.

• Apparitions seen in the main rooms and on the stairs, often identified by storytellers as Sallie Dooley, an identification that rests on nothing more than the domed portrait of her overhead
• Whispers and indistinct voices in empty rooms
• Sudden cold drafts
• Figures that visitors believe they have caught in photographs
• EVP recordings collected by paranormal groups during organized investigations

There is no verification for any of it. A stone and marble villa on an exposed mountain crest, built around a central dome and a stairwell, vacant for long stretches and only partially heated for most of its life, is a building that moves air and carries sound in ways that are genuinely hard to trace. The stories are persistent, and the house has never marketed itself as haunted. Both of those things can be true at once.

Getting Inside Swannanoa Palace

This is not an open historic house museum and it is not an abandoned property to wander. Since 2007 Skyline Swannanoa, Inc. has run the estate as a private venue available only by private booking or ticketed events, which means access depends entirely on what the owners have scheduled. Anyone hoping to investigate should arrange it through the owners in advance rather than turning up; the mansion is mid-life in a long preservation effort, and the external restoration alone cost three million dollars.

For the merely curious, the setting does a great deal of the work on its own. The villa looks out over both the Shenandoah and Rockfish valleys from the top of the Blue Ridge, at the point where Skyline Drive ends and the Blue Ridge Parkway begins, which makes it an easy addition to a drive along either road even on a day when the gates are shut.

Sources

• Virginia Landmarks Register (Virginia (official))
• NPGallery NRHP Archive Search (National Park Service)
• skyline-swannanoa-inc.square.site
• Wikipedia: Swannanoa (mansion)

Ghost Tours Nearby

Chains, Coffins, & Curses: Charlottesville Ghost Tours★ 3.6 (25)from $26

Affiliate links: BeyondHaunted may earn a commission, at no extra cost to you.

More Haunted Mansions

Major Grahams MansionKendall ManorJames Allison MansionThe Haunted History Of The Kreischer MansionIndiana State HouseHaunted Beattie Mansion