Each movie scene has a corresponding json file that represents the scene knowledge graph (KG). There are two main components (keys) in each json (knowledge graph) file: "nodes" and "links": 1- nodes : The nodes value is an array of objects. Where each object represents one node in the knowledge graph. A node object consists of 3 key-value pairs: a- "type" : represents the type of the node. Types available are : (Location, Person, Emotion, Interaction, Sequence, Sentiment) b- "text" : representsthe label of the node. Such as location name or type, person/actor name, type of emotion, interaction or sentiment. Please refer to the vocab.dvu.json file for a complete list of emotions, interactions, sentiments, and locations. c- "key" : represents an id value to this specific node (e.g. -1, -2, -3, etc). This value is used later in the "links" array of objects to show which nodes are linked to each other. NOTE: Any other key-value pairs, not mentioned above, may appear but can be ignored (e.g. there may be occasions where annotators used "colors" for the node shapes) 2- links : The links value is an array of objects. Where each object represents one link (edge) between two nodes. A link object consists of the following key-value pairs: a- "from" : Uses the id (key) value of the source node as defined above under the node object "key" value. b- "to" : Uses the id (key) value of the target node as defined above under the node object "key" value. c- "text" : represents the value/name of the relation between the two nodes (persons). Please refer to the vocab.dvu.json file for a complete list of relationships. d- "dir" : If this is present, the default value is "2". This means that this relation or interaction is bidirectional. While if absent, means it's unidirectional. e- "color" : in some cases this key-value pair may appear. You can safely skip it. It was used by some annotators to color the edge line between the two nodes. Please see a sample scene KG output (in json format and as png as well) for demonstration: Sample-sophie-23.json ; Sample-sophie-23.png Important annotation guidelines and notes: 1- Each scene KG includes a location node to represent the location of the actors in that scene. If a subset of actors existed in different location (e.g. phone conversation), there should be additional location node. 2- A link (edge) between a person and a location means that person was in that location for the given scene. The persons names in the KG files should be consistent with the images file names of the movie actors (see the folder movie_knowledge_graph//images/) 3- An emotion node was used ONLY when the annotator felt the actor's emotion was NOT neutral. 4- The relationships between persons was annotated in the static whole movie KG (see the folder movie_knowledge_graph//.tgf file). In the scene annotations, relationships are only explicitly annotated when the annotator felt the the relationship is established and became apparent. Once annotated in a scene, it's not being repeated in following scenes, unless in some circumstances, if the relationship changed over time. 5- An interaction is ONLY between persons. At least two persons need to be interacting together. The direction of the links (edges) represents the source and target persons of the interaction. For example the "Asks" interaction may be shown as an edge between node A going into the interaction node, then another edge going from the interaction node to node B to demonstrate that person A "Asks" person B. However, if the interaction is done by both persons, then there will be an edge going from each person node to the interaction node. 6- The Sequence node is a special type of node that is used to annotate the ORDER of the interactions in the scene. If multiple interactions happened between different actors, the annotators use this node to annotate the sequence of interactions. The label value (value of the "text" key) of a "Sequence" node is an integer number that represents the order of linked interaction (the value 1 represents the first interaction, 2 represents the second, etc). Please note that if a scene has only one interaction, the sequence node annotation was optional. So, in those cases there may be no sequence nodes present in the json file for the given scene. 7- One or more sentiment nodes (not linked to any other nodes in the graph) are given to each scene. 8- Although every effort has been made to make sure the annotation process is consistent, there may be few occasions where annotators missed to add a sequence node when multiple interactions happened in a scene. 9- In some scenes where a person may have been in multiple locations, some annotators linked a single person node to multiple location nodes. While others created new (yet same) person node and linked it to the new location node. In the second scenario, those two or more (same person) nodes should be combined.