Showing posts with label DNA Painter. Show all posts
Showing posts with label DNA Painter. Show all posts

Friday, September 6, 2024

DNA Painter - Creating your chromosome map

In Module 3 of 'Combining genetic and genealogical research' we discussed ways to work from your chromosome data to maximise your chance of finding your MRCA.  The purpose of undertaking this exercise is to consolidate your understanding of the principles and processes we discussed and to prepare for our next workshop.  By examining results at all DNA sites and working between them, you will increase your knowledge of specific segment areas which may lead to more successful outcomes.  

So far in the course, we have completed a number of exercises where we identified confirmed and triangulated segments in our genome. We may have identified the shared common ancestor for some of these, or at the very least identified a side or likely ancestral couple based on others sharing in each triangulated group.

This activity aims to help you visualise the segment analysis you have undertaken so far and map your known 'confirmed' and 'triangulated group' segments.  There are many approaches to creating chromosome maps, this is just one way to help you get started.

By now you should understand the theory behind two sides to every chromosome, including how to identify triangulated segments and groups. You should also have decided upon your method for retaining details of the DNA matches you have researched, the segments they match on and the results of your analysis, to avoid rework and improve your productivity.  Practice reviewing clusters of shared matches to identify triangulated segments and complete this exercise to start to build a chromosome map.


EXERCISE 
STEP 1:
  • Create an account at DNA Painter.  A free account allows you to develop one chromosome map.
  • Choose the best candidate to map for your current research.  Ideally, map yourself, or one of your parents;
  • Familiarise yourself with DNA Painter and concepts of chromosome mapping.  Suggested resources include the DNA Painter Blog and this 'free' introductory Webinar.






EXERCISE STEP 2:
  • Decide how you are going to map your segments, I favour mapping confirmed segments to the ancestor from whom I inherited the segment.  Others may choose to map to the parents - ie the ancestral couple.  It is a personal choice.  The instructions in this blogpost will be to map to to specific ancestor.
  • First we are going to identify all our close cousins, up to 3rd cousins, where we have a confirmed paper trail and their total shared segments are within the predicted ranges - AND their match is on a segment data site.
  • If you have not already done so, do a 'one on one' with each of them and add the results to your match and segment data lists.
  • I would recommend starting at second cousins as they only share one of your grandparent lines and are the most useful.  
  • Personally, I do not map first cousins because I already have my mother tested, but again this is personal choice.  Any segments I share with my first cousins came from our maternal grandparents and from a mapping perspective would just be mapped to my mother, providing limited value.  I also find they complicate the map.
  • However if you have no parents tested first cousins can be particularly useful to help you determine the sides for your matches and should be mapped to your respective parent.
  • First cousins once removed from the older generation may be different.  I do use my mothers first cousin on my map, because their segments when mapped are like a second cousin - only inherited from one of my grandparent lines.  
  • First cousins once removed from the younger generation provide the same information as first cousins and can only be mapped to my mother, so I don't include them for the same reason;
  • First cousins, 1C1R and children can be particularly useful for inferred mapping which is a complex technique that we will briefly touch on in Module 4.  I prefer to map these segments on a unique map for that purpose.
  • Follow the instructions on DNA Painter to map the segments of all your known cousins who meet the criteria in dot point 2;
  • You should end up with a map that looks something like this one, it may not look as populated, that will depend on how long you have been researching and the number of matches you have identified at chromosome sites.


Example segment map



EXERCISE STEP 3:
  • Make sure you have included all the segments you identified in the Module 1 exercise - Identifying the segments of a known ancestor - GEDmatch;
  • As these are all known matches, they all should be mapped to either the maternal or paternal sides and there should be limited ancestor overlap;
  • Review the map to ensure that any overlapping segments are coming from the same ancestor, or another further back on the line of the more distant ancestral couple.  
  • All overlapping matches should triangulate if you have mapped them correctly as they are inherited from the same distant ancestor.
  • Depending on how you labelled your matches, when you expand one of the chromosomes it might look the image below.   I label my matches to correspond with the MRCA couple and the ahnentafel number of the ancestor who gave me the segment, the match name remains constant.  In this case 007 is my maternal grandmother Mona Veronica Murphy, segments inherited from her are labelled in dark green.  Her parents are John Murphy and Rebecca Cassidy.  I share the MRCA of Murphy-Cassidy with my 1C1R MLAS, however because he triangulates with all my Cassidy-Sweeney cousins in the second segment area, that segment has been mapped as a Cassidy-Sweeney segment and coloured light green to reflect being inherited from my great grandmother Rebecca Cassidy, 

Expanded maternal segment



EXERCISE STEP 4:
  • Next we are going to map the 'Triangulated groups' we have already identified in each of the previous exercises.
  • You will need to have come up with a unique name for each of your groups.  In DNA Painter we will map each triangulated group as a 'New Match';
  • If we are clear where the segment is coming from, we could map it to the appropriate ancestor - eg. you share the group with a paternal second cousin, so you know the segment was inherited from your paternal grandfather - so we could map the segment to the paternal grandfather.  However this may not always be possible and you may need to allocate some groups to 'Both sides' until the MRCA is identified.
  • Review the output of GEDmatch exercise from Module 1 Identifying the triangulated segments of an unknown ancestor - GEDmatch and 'Paint all New Matches'.
  • Review the output of My Heritage exercises from Module 2  Identifying triangulated segments and groups - My Heritage (downloads)Identifying triangulated segments and groups - Pedigree Thief and the My Heritage Cluster report and 'Paint all New Matches'.
  • The example below shows how the segment map might look if you can't allocate sides.  Once you determine an MRCA you would then map the segment to the ancestor you inherited it from, ie paternal or maternal. 


Segments not yet allocated to a side


REVIEW:
  • Are your segments consistently aligning, with start and end points not overlapping for your four grandparents?
  • Where segments do overlap, are matches on the same ancestral line but just matching to a more distant ancestor?
  • Can you identify any segment locations where you have evidence of 'walking back the segment'?


As you continue to identify triangulated segment groups add them to this map to keep track of where you are up to.  If you use GDAT the segment map will auto-populate, however DNA Painter maps are easier to share with others and there are many other ways you can utilise them.

Over time, as your map populates, it will help you identify possible ancestral lines for new matches and improve your analysis processes.   Refer to the Module 3 blogpost for other relevant material.

If you have a paid DNA Painter account you can create more than one map.  Now that downloads are available again from Family Tree DNA, why not download your matches and use the Bulk Import Feature at DNA Painter to look at all your matches on one map.


Veronica Williams

Originally published: 6th September 2024

Last updated:  24 September 2024








Sunday, October 24, 2021

Tools: Clustering for Chromosome Analysis

Clustering tools are a great way to quickly identify groups of matches with a relationship to each other.  

As we know shared matches are 'clues', whilst shared segments are 'evidence' of a shared ancestor.  All cluster tools identify matches that are likely to be clues of common relationships.   The best types of clusters in my opinion, are shared segment clusters, however every cluster analysis you do is likely to give you new ideas about how your matches might relate to you.

This post is aimed at identifying where clustering can be undertaken and whether they provide shared match or shared segment clusters.  Click on the heading hyperlinks for more information, plus please refer to the blog posts at the end of this page for more information about using each of the different tools.

  

DNAGedcom Client 

Using the cluster tool at DNAGedcom requires a subscription which can be taken out for a minimum of one month.  The DNAGedcom client provides clusters based on the Collins Leeds Method for AncestryDNA and FamilyTreeDNA.  

As AncestryDNA does not provide segment data, the clusters generated are 'shared match' clusters.  Generating clusters with matches >30cMs will generally given an indication of shared ancestry, however clusters generated with less than that amount may give false leads with matches potentially sharing different more distant ancestors.   


DNAGedcom has an another advantage when working with AncestryDNA data.  It allows you to identify other shared matches that are below the 20cMs threshold, provided they share >20cMs with the match you have in common.  This can be confusing, hopefully this cheat sheet helps. 

The FamilyTreeDNA clusters generated by DNAGedcom are based on shared segments and most matches in the cluster are usually triangulated groups.  Due to this, smaller cMs defaults can be used and each cluster will provide clues of a shared common ancestor.  Additionally, shared matches are also shown in grey.


  

GEDmatch 

There are now 2 cluster tools at GEDmatch, they require a Tier 1 subscription which can be taken out for a minimum of one month. 

The first tool is the AutoTree Clustering tool which is based on shared segments and each cluster of the same colour is usually a triangulated group.  Similar to the DNAGedcom tool for FTDNA, smaller cMs defaults can be used and each cluster will provide matches of interest sharing common ancestors.



In Oct 2021 a second tool was released called AutoSegment.  It provides triangulated data.  Refer to the Roberta Estes blogpost for more information on this great new tool.





The free tool at My Heritage is an example of a 'shared match' cluster, so whilst the matches in each cluster have something in common, they may not all descend from the same common ancestor.  The advantage of this cluster tool is that it also provides segment detail.  In the example below interrogation of Cluster 3 (yellow) revealed four distinct triangulated groups, each providing separate clues regarding the identity of the common ancestor.  The main limitation with this tool is that you are unable to change or refine the search parameters. 

Genetic Affairs

Genetic Affairs is a third-party tool created by Evert-Jan Blom that provides great tools for use with 23andMe, FTDNA, GEDmatch and My Heritage DNA data.  Evert also developed the free My Heritage cluster tool and the new GEDmatch AutoSegment tool.  

The Genetic Affairs site is another subscription site that provides a range of tools to assist with your analysis.  Running the tools at Genetic Affairs provides more flexibility and in particular for the My Heritage cluster also shows interrelationships, something not provided by the free tool.

Genetic Affairs provides many other useful tools on its site, including AutoKinship, AutoTree and AutoPedigree.


Shelley Crawford Clusters 

Connected DNA used to provide fabulous network maps of shared match clusters for AncestryDNA, FamilyTreeDNA, and 23andMe.  However, as at October 2021 Shelley is taking a break and no orders are being taken at the moment.  We hope she will be back soon.


DNA Painter Cluster Auto Painter 

You can upload clusters created from DNAGedcom (FTDNA only), My Heritage, GEDmatch and Genetic Affairs to the DNA Painter Cluster Auto Painter to visualise the segments and make notes about the results of your analysis.  This allows for a more visual approach to analysing your segment data.  The image below has been generated from the output of the AutoSegment at GEDmatch.



Shared Clustering Tool

The Shared Clustering tool by Jonathan Brecher works from AncestryDNA shared match lists. Rather than providing a single list of matches ordered only by the strength of the match, Shared Clustering divides that list into smaller clusters of matches that are likely related to each other.  Downloading directly from AncestryDNA has been disabled, but files extracted using DNAGedcom can be uploaded.  It only works using Windows.



RootsFinder 

RootsFinder is a family tree building and DNA analysis website. The premium level has DNA features for a subscription fee.  The triangulation (cluster) view allows you to view your matches in clusters – otherwise known as a network graph.



Ideas for exploring your cluster

* Explore the matches in the cluster and check if the shared matches are also sharing the same segments;

* Are there any triangulated groups within the cluster?  Explore these matches first.  Remember you can expand each triangulated group by checking your segment data for others not appearing in the cluster report, who may not have met the cluster criteria.

* Are there any 'bridge' matches in the cluster?  Use these to help you to find others who match in the same segment area at other sites.

* If the cluster includes matches not triangulating with the core group, explore those segment areas as these may provide additional clues to the possible relationship of those in the cluster. 

* Do the genealogy!  Build research trees for your matches and revisit your own pedigree to search for the what is in common between the cluster group - surnames, locations, ethnicities?

* Once you have identified a 'side' or MRCA make notes on your master list and at the DNA site for all the matches in the triangulated group. 

* You may also wish to allocate a reference number to your Cluster for future reference.  Remember all the tools have their own numbering systems which constantly change with each report.

* Make sure you are systematic with your notes so that next time you generate a cluster report you can easily see matches that have been worked on before.

* Don't forget to consider the other side of the chromosome - use what you now know to mark the segments on the opposing side.   Explore the other side of the 'specific segment area' for more triangulated groups.  By looking at both sides concurrently you can then mark others not triangulating as potentially false positive matches, saving analysis time in the future.

My group numbering system has changed many times over the years, it has been adapted from the Jim Bartlett method.  It doesn't need to be as complex as this, but it needs to be meaningful for you.



More information:

Check out these links for useful blogs that may help you interpret how the different cluster sites work:

* The Leeds Method, Dana Leeds, 2018 

* What to do after Clustering (You Tube), Dana Leeds, 2024

DNA Sleuth, 2019

Walking the Clusters Back, Jim Bartlett 2019

* Cluster Auto Painter, Jonny Perl 2019

* Shared Clustering - A great tool! Jim Bartlett, 2019

* 10 ways to group your genetic clusters, Family Locket, 2019

* Connecting the Dots, My Heritage 2020

* Fast Ways to Cluster your DNA Matches, Family Locket 2020

* Genetic Affairs Tools and how to use them, Roberta Estes 2020

* Walking Back the Clusters, Veronica Williams 2020.  Demonstration of applying Jim's method.

* Using DNA tools to solve a family mystery, Vicki Hails 2020

* Annotating a Cluster Auto Painter Map, Jonny Pearl 2020

Auto Segment Triangulation Tool at GEDmatch, Roberta Estes 18 Oct 2021

* RootsFinder Network Graphs, Family Locket Oct 2021

RootsFinder - Making Triangulated Network Graphs, Family Locket Dec 2021


AncestryDNA

Whilst AncestryDNA does not provide chromosome information it is always best to start your analysis there, due to the large numbers in the database and its many pedigrees.  AncestryDNA Clustering can be done using the DNAGedcom CLM tool, Shared Clustering Tool and the DNA2 Tree app.  You will often find Ancestry testers at other sites, particularly GEDmatch and My Heritage (a growing database with lots of family trees).  Always look for 'bridge matches' between the sites as they can help to expand your research pool and help you tie your triangulated groups together with broader shared match clusters.


Veronica Williams

First published: 24 Oct 2021

Last updated: January 2025


2024 NOTE:  Since September 2023 many downloads have been unavailable due to restrictions at the DNA companies, this includes the very handy DNA2Tree Tool.  GEDmatch has remained available throughout this time and finally FTDNA returned their reports in late August 2024.  We hope things will change at My Heritage and 23andMe soon.  

2025 NOTE: The release in late 2024 of AncestryDNA's new Pro Tools feature, Enhanced Shared Matching (ESM) is proving to be a 'game changer' for identifying family groups and clusters within your shared match lists.  Using the data in ESM you can often work out relationships and family groups for matches that don't have trees!  As always, interrogate AncestryDNA clusters to find people who have their data on chromosome sites.  The reverse is also recommended, if you have triangulated groups (TG) for a segment you know belongs to a 'brick wall' ancestor who you can't identify, look for people in the TG's who might also be on AncestryDNA and try to drill into their shared matches to broaden the clues for your search.