More Wikipedia:

The restaurant's name was devised on a cancelled 1936 road trip to California, in which Beverly spilled a picnic basket of chicken after Rubye hit a bump in the road while driving on the Oklahoma prairie Rubye remarked something to the effect of "This is really chicken in the rough”. After this occurred, they turned around and headed back to Oklahoma City.