Methodology

The Inclusion List was determined through a process of assigning points for series that met inclusion metrics. A total of 15 points could be earned– 5 for on screen inclusion and 10 for behind the camera inclusion.

To determine on screen inclusion scores, the series regular cast members for each series were identified. Then, each series regular character was evaluated for gender, race/ethnicity, and age. Information on whether the character was LGBTQ+ and/or shown with a disability was also obtained from online sources. Annenberg Inclusion Initiative research assistants also watched the first episode of each series (when available) to confirm judgments made from online information. A series could earn up to 5 points for on screen inclusion based on the 5 inclusion indicators (gender, race/ethnicity, LGBTQ+, disability, age). A point was awarded when the percentage of series regulars within each inclusion indicator reached proportional representation to the U.S. population. In the table below, each cell represents the potential to earn at least one point if the metric was achieved.

Behind the camera, it was possible for a series to earn up to 1 point for each behind the camera position evaluated– 10 in total. The positions were: Director, Writer, Producer, Cinematographer, Editor, Composer, Production Designer, Costume Designer, Casting Director, and First Assistant Director. Every episode of a season was examined to determine who worked in each of the positions evaluated.

Up to 1 point was allocated for each behind-the-camera role. Points were based on the percentage of women or people of color credited in a specific position. This percentage was calculated across all people credited within a specific position. For positions in which multiple individuals were credited, a fraction of a point was allocated for every woman and/or person of color in the role. If 5 writers were credited on a season of 10 episodes and three were women and 2 were people of color, the series earned 0.5 points for that position. 

There were two exceptions. For casting directors and costume designers, the historically gendered nature of the role required a different approach. For these positions, points were allocated based on the percentage of people of color in those positions.

Points were totaled across all available metrics on screen and behind the camera, and series were ranked according to their full point total. The Inclusion List of the top 100 series from 2023 is composed of the series that earned between 6 and 12.2 points.

To determine the sample of series that would be evaluated for the Inclusion List, Nielsen data was used to identify all broadcast, cable, and streaming series that were released between January 1st, 2023 and December 31st, 2023. This list was refined to include only content that was scripted, live action, and aired in prime time (for broadcast and cable series only). We further narrowed the list by focusing on broadcast and cable channels that were subsidiaries or affiliated with major parent companies (Amazon Prime, AMC Networks, Apple TV Plus, Disney Plus, E.W. Scripps Company, Fox Corp., Hallmark Media, HBO Max, Hulu, Lionsgate, NBC Universal, Netflix, Nexstar Media Group, Inc., Paramount Global, Paramount+, Peacock, Walt Disney Company, Warner Bros. Discovery). Lastly, only  English-language series that had the U.S. as the country of origin were included.

Data regarding on-screen series regular characters was collected by the Annenberg Inclusion Initiative team. Series regular characters were identified from information provided by Luminate. When this information was not available, series regular characters were identified in one of two ways. First, by examining cast listed on a streaming series platform. Second, by using IMDbPro cast lists for each episode within a season to identify which characters appeared in 75% or more of the episodes. Series regulars could not be identified from any sources for four anthology series and were excluded from further analysis.

After identifying series regular characters, research assistants used online sources to identify the gender, race/ethnicity, and age of each character. Additionally, information was sought to determine if characters identified as LGBTQ+ or were shown with a disability during the season. 

A total of 1,946 series regular characters were identified. Once a series regular character was identified, information about the character’s gender (male, female, non-binary); race/ethnicity (White/Caucasian, Hispanic/Latino, Black/African American, American Indian/Alaska Native, Native Hawaiian/Pacific Islander, Asian, Middle Eastern/North African, Multiracial/Multiethnic); and age (child, teen, young adult, middle aged, elderly) was sought from online sources. Additionally, LGBTQ+ identity (lesbian, gay, bisexual, transgender, not lesbian, gay, bisexual or transgender); and disability (present, absent) were assessed by using episode and season summaries. At the analysis level, race/ethnicity was collapsed to reflect a measure of underrepresented (Hispanic/Latino, Black/African American, American Indian/Alaska Native, Native Hawaiian/Pacific Islander, Asian, Middle Eastern/North African, Multiracial/Multiethnic) vs. not underrepresented for each character. Finally, the first episode of a series was viewed to confirm judgments made from online sources.

A total of 10 behind-the-scenes roles were analyzed: Director, Writer, Producer, Cinematographer, Editor, Composer, Production Designer, Costume Designer, Casting Director, and First Assistant Director.

The data collection process involved identifying all individuals who worked in these roles for every episode across each series in the sample using IMDbPro. Across the sample, there were 59,711 crew roles evaluated. 

Across positions, specific credits were included for each role. In general, location-based or unit-based credits were excluded from analysis. Writers included those earning “written by,” “story by,” “screenplay by,” or “teleplay by” credit and excluded writers responsible only for source material or in staff roles not associated with an episode. For Producers, credits included: “Executive,” “Co-Executive,” “Producer,” and “Co-Producer.” Individuals who were credited as “First Assistant Director” were included, and only when no First Assistant Director was credited on a movie was the individual(s) earning “Assistant Director” with no additional modifier included in the sample. Casting Directors were those responsible for overall casting, and location-based casting directors were not included. 

Gender and race/ethnicity information was then obtained for each nominee using online sources, such as Luminate, Studio System by Gracenote, IMDbPro, U.S. Census records, interviews, and social media posts. Gender was categorized as male, female, or non-binary, and race/ethnicity categorized as white or underrepresented (including Black/African American, Hispanic/Latino, Asian, American Indian/Alaska Native, Native Hawaiian/Pacific Islander, Middle Eastern/North African, and Multiracial/Multiethnic).

When no information on race/ethnicity could be found, a photograph of the individual was obtained, and senior research team members rendered a judgment on the individual’s race/ethnicity and/or gender. In the past, this process has been used to determine gender and race/ethnicity of series regulars, and there was a .90 correlation between independent judgments made by the research team and documented information on racial/ethnic identity across 2,175 series regulars appearing in episodic content from the 2014-15 season.

There are limitations to this methodology, including the potential for incomplete or inaccurate information available online and the use of limited information to make judgments on race/ethnicity for individuals where no information could be found. However, efforts were made to obtain as much information as possible to ensure the accuracy of the analysis. There were a total of 247 unique individuals out of 7,175 for whom no information could be obtained about gender and/or race/ethnicity. These individuals were excluded from the analysis.