Python - Concatenate Values with Same Keys in a List of Dictionaries
Last Updated : 29 Jan, 2025
We are given a list of dictionaries where the values are lists and our task is to concatenate the values of the same keys across these dictionaries. For example, if we have a list of dictionaries like this: [{'gfg': [1, 5, 6, 7], 'good': [9, 6, 2, 10], 'CS': [4, 5, 6]}, {'gfg': [5, 6, 7, 8], 'CS': [5, 7, 10]}, {'gfg': [7, 5], 'best': [5, 7]}] then the output will be: {'gfg': [1, 5, 6, 7, 5, 6, 7, 8, 7, 5], 'good': [9, 6, 2, 10], 'CS': [4, 5, 6, 5, 7, 10], 'best': [5, 7]}
Using defaultdict
This method uses defaultdict from the collections module which automatically creates an empty list for any key that doesn't exist yet. This eliminates the need to check for keys before adding values.
Python from collections import defaultdict li = [{'gfg' : [1, 5, 6, 7], 'good' : [9, 6, 2, 10],'CS' : [4, 5, 6]}, {'gfg' : [5, 6, 7, 8], 'CS' : [5, 7, 10]},{'gfg' : [7, 5], 'best' : [5, 7]}] res = defaultdict(list) for d in li: for k, v in d.items(): res[k].extend(v) print(dict(res)) Output{'gfg': [1, 5, 6, 7, 5, 6, 7, 8, 7, 5], 'good': [9, 6, 2, 10], 'CS': [4, 5, 6, 5, 7, 10], 'best': [5, 7]} Explanation:
defaultdict ensures that any key accessed in res will automatically have an empty list associated with it.extend() method appends all elements of v to the existing list associated with the key k in the res dictionary.
Using the itertools module
This method uses itertools.chain.from_iterable() to concatenate values of the same keys across all dictionaries in the list, it first extracts all unique keys and then combines the values associated with each key from all dictionaries.
Python import itertools li = [{'gfg': [1, 5, 6, 7], 'good': [9, 6, 2, 10], 'CS': [4, 5, 6]}, {'gfg': [5, 6, 7, 8], 'CS': [5, 7, 10]}, {'gfg': [7, 5], 'best': [5, 7]}] # Using chain.from_iterable() to create a single list of all values for each key li = {key: list(itertools.chain.from_iterable([d.get(key, []) for d in li])) for key in set().union(*li)} print(str(li)) Output{'good': [9, 6, 2, 10], 'CS': [4, 5, 6, 5, 7, 10], 'best': [5, 7], 'gfg': [1, 5, 6, 7, 5, 6, 7, 8, 7, 5]} Explanation:
- Extract all unique keys from the list of dictionaries using
set().union(*li). - For each key, concatenate the values from all dictionaries using
itertools.chain.from_iterable() and create a dictionary with the concatenated values.
Using reduce() from the functools module
In this method we use reduce() function from the functools module to iteratively combine dictionaries in the list by merging them and appending values for the same keys.
Python from functools import reduce li = [{'gfg': [1, 5, 6, 7], 'good': [9, 6, 2, 10], 'CS': [4, 5, 6]}, {'gfg': [5, 6, 7, 8], 'CS': [5, 7, 10]}, {'gfg': [7, 5], 'best': [5, 7]}] res = reduce(lambda d1, d2: {**d1, **{k: d1.get(k, []) + v for k, v in d2.items()}}, li) print(str(res)) Output{'gfg': [1, 5, 6, 7, 5, 6, 7, 8, 7, 5], 'good': [9, 6, 2, 10], 'CS': [4, 5, 6, 5, 7, 10], 'best': [5, 7]} Explanation:
lambda d1, d2 is a function that takes two dictionaries.{k: d1.get(k, []) + v for k, v in d2.items()} in this expression, for each key in d2 we append its values to the corresponding key in d1. If the key isn't in d1, it starts with an empty list.{**d1, **new_dict} merges the updated dictionary into d1.reduce() is used to apply this to all dictionaries in the list thus resulting in a single merged dictionary with concatenated values.
Using a loop
This method iterates through the list of dictionaries using a loop and concatenates the values of each key into a single list.
Python li = [{'gfg': [1, 5, 6, 7], 'good': [9, 6, 2, 10], 'CS': [4, 5, 6]}, {'gfg': [5, 6, 7, 8], 'CS': [5, 7, 10]}, {'gfg': [7, 5], 'best': [5, 7]}] res = {} # Iterate through each dictionary in the list for d in li: for k, v in d.items(): res[k] = res.get(k, []) + v print(res) Output{'gfg': [1, 5, 6, 7, 5, 6, 7, 8, 7, 5], 'good': [9, 6, 2, 10], 'CS': [4, 5, 6, 5, 7, 10], 'best': [5, 7]} Similar Reads
Python - Keys associated with value list in dictionary
Sometimes, while working with Python dictionaries, we can have a problem finding the key of a particular value in the value list. This problem is quite common and can have applications in many domains. Let us discuss certain ways in which we can Get Keys associated with Values in the Dictionary in P
4 min read
Python - Keys associated with Values in Dictionary
Sometimes, while working with Python dictionaries, we can have problem in which we need to reform the dictionary, in the form in which all the values point to the keys that they belong to. This kind of problem can occur in many domains including web development and data domains. Lets discuss certain
5 min read
Convert a list of Tuples into Dictionary - Python
Converting a list of tuples into a dictionary involves transforming each tuple, where the first element serves as the key and the second as the corresponding value. For example, given a list of tuples a = [("a", 1), ("b", 2), ("c", 3)], we need to convert it into a dictionary. Since each key-value p
3 min read
Ways to create a dictionary of Lists - Python
A dictionary of lists is a type of dictionary where each value is a list. These dictionaries are commonly used when we need to associate multiple values with a single key. Initialize a Dictionary of ListsThis method involves manually defining a dictionary where each key is explicitly assigned a list
3 min read
Merging or Concatenating two Dictionaries in Python
Combining two dictionaries is a common task when working with Python, especially when we need to consolidate data from multiple sources or update existing records. For example, we may have one dictionary containing user information and another with additional details and we'd like to merge them into
2 min read
Python - Convert list of dictionaries to JSON
In this article, we will discuss how to convert a list of dictionaries to JSON in Python. Python Convert List of Dictionaries to JsonBelow are the ways by which we can convert a list of dictionaries to JSON in Python: Using json.dumps()Using json.dump()Using json.JSONEncoderUsing default ParameterDi
5 min read
How to use a List as a key of a Dictionary in Python 3?
In Python, we use dictionaries to check if an item is present or not . Dictionaries use key:value pair to search if a key is present or not and if the key is present what is its value . We can use integer, string, tuples as dictionary keys but cannot use list as a key of it . The reason is explained
3 min read
Python | Convert list of tuple into dictionary
Given a list containing all the element and second list of tuple depicting the relation between indices, the task is to output a dictionary showing the relation of every element from the first list to every other element in the list. These type of problems are often encountered in Coding competition
8 min read
How to Add Same Key Value in Dictionary Python
Dictionaries are powerful data structures that allow us to store key-value pairs. However, one common question that arises is how to handle the addition of values when the keys are the same. In this article, we will see different methods to add values for the same dictionary key using Python. Adding
2 min read
Append list of dictionary and series to a existing Pandas DataFrame in Python
In this article, we will discuss how values from a list of dictionaries or Pandas Series can be appended to an already existing pandas dataframe. For this purpose append() function of pandas, the module is sufficient. Syntax: DataFrame.append(other, ignore_index=False, verify_integrity=False, sort=N
2 min read