Skip to content
COEY
Capabilities

People and relationships

The faces GroundSlate knows, the names on them, and how the people are related, so an agent can tell who is who.

People and faces

Find the distinct people in a video and match them against your face catalog

Run face recognition on a file downloaded with fetch_asset, which arrives with recognition off

Add another reference face (a new angle or light) to a known person to improve recognition

Name a person, or correct their name

Correct a person's name everywhere at once: shot descriptions, the Summary tab and search results update instantly, with no re-analysis

Add a named person to the catalog

One person's full record by id (p394): name, title, note, sex, how many videos they appear in, and the list of appearances

Every known person, named or not, with how often and where they appear

Ranked named people someone might actually be, for "this is someone else, who?"

See a person's faces as cropped pictures. For where a face sits in the frame, use people_sheet

See where a person's footage was filmed, by GPS

See which face sources were merged into a person, as in "Faces in this record"

Confirm the people in a video, which index_video waits for

People recognition was not sure about, strongest suggestion first

Merge two entries that are the same person

Merge many entries into one person in a single call, for someone split across many Unknowns after indexing

For each named person, gather up the Unknown cards that are really them

Reset and regroup the face catalog, splitting a wrongly merged group back into separate people

Find clips whose shots still name someone who, after recluster_identities(apply=True), is no longer in them

Move known people onto a new recognition model without re-indexing

Recreate a person's missing face picture without re-scanning the clip, for a person showing a blank silhouette

Assign an Unknown face in one clip to a known person

Hide an Unknown face in one clip (Ghost, in Review faces)

Ghosted or forgotten people who can be restored, as on the People page's Ghosts tab

Mark a detection as not a face at all (jeans, food, a blur). Ghost hides a real person; this says there was never a person

Record that two people are not the same person, permanently

Remove a person from the catalog

Mark a detection as not a person and move it to Quarantine, where it can be recovered

Undo forget_person or the app's Ghost button and bring the full record back

Bring a quarantined detection back into the people catalog, for a real face that was wrongly rejected

Detections judged not to be people (animals, statues, masks, bad crops), which can be recovered

Remove one clip's wrong sightings from a person, by the clip's video path

Remove a person tag you added to a clip, the reverse of tag_person

Tag a person as appearing in a video. person is an id (p3) or a name; a new name creates a new person

Add a title or role, notes, or sex to a person, for use in edits, lower thirds and graphics

Set a person's picture from an image file and lock it so indexing cannot replace it

Report clips with broken face or analysis data. Read-only by default

Who is in a video, when, and where in the frame, with each face's box [x0,y0,x1,y1] (0 to 1) in frames[].boxes[]

Whether the face engine (YuNet and SFace) is installed, how to set it up, and how many people are in the catalog

Set the minimum confidence for YuNet face detection (0.1 to 0.99)

Recheck people already in the catalog to catch faces that were never human (animals, statues, masks)

The unnamed faces waiting for a name, strongest probable match first, each with the named people it might be and why. Read-only

Compare YuNet with Apple Vision on the same frames of your own clips

Turn Apple Vision face detection on or off (off by default)

Whether Apple Vision face detection is available on your Mac and switched on

Match the faces in one indexed photo to your people catalog, as detect_people does for video

Match faces in many photos to your people catalog, a limited batch at a time

List indexed images that have not been analyzed yet. Read-only

Preview an image analysis run without running it. Read-only

Analyze photos that have not been analyzed yet, a limited batch at a time

Relationships and context

Record how two people are related, by their pN ids, so you can later ask "who are my clients" or "who is in Zane's family"

Remove the relationships between two people: all of them, or only the type named in kind

Relationships for one person (by pN id), or all of them

Every relationship type, with how many relationships use it

Rename a relationship type

Merge two relationship types that mean the same thing, such as "client" and "My clients". Duplicates collapse to one and from_type_id is removed

Delete a relationship type

A person's full family (parents, children, siblings, grandparents, aunts and uncles, nieces and nephews, cousins), worked out from the parent, child and sibling links you recorded

Every relationship written out in plain text, grouped by person, using names where known and pN ids where not

People probably related to someone but not yet linked, ranked by family links and shared surnames. For example, a parent's spouse may be a mother

The matching relationship the other way round, using the catalog's sex field (an uncle's nephew or niece, a son's father or mother), or null when there isn't one

Create a circle: a named group, such as a workplace, whose members are connected by belonging to it. Once enough of its people have footage, it also gets a Library collection of everything they are in

Add people to a circle, many pN ids at once

Take people out of a circle, many pN ids at once

Change a circle's name, kind, member_label or note, or one member's role and dates

Every circle, or only one person's circles (person_id), with kind and member count

One circle by rcN id, with each member's name, role and dates

Merge two circles for the same place. Members join; the merged circle is removed

Delete a circle by rcN id

Suggest circles from relationships you already recorded, such as everyone linked as coworkers or classmates

Search suggestions as you type: matching people, places, cameras, events, projects and text, each with its clip count, most specific first

Where you are and what the AI models are being told. A cheap, good first call in any session

Set text added to the start of every vision model prompt (index_video, analyze_style, track_subject)

Set text added to the start of every reasoning model prompt (summaries and insights)

This list follows the current release. Something missing, or a description that is out of date? Tell us.