misc/firestuff
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

A new generation of Google MySQL tools

Browse Source
This commit is contained in:
Ian Gulliver
2019-04-15 03:14:36 +00:00
parent 0d4cd363a3
commit caadab751d
4 changed files with 42 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

21
2011-04-01-a-new-generation-of-google-mysql-tools.html Normal file
View File

@@ -0,0 +1,21 @@
<!--# set var="title" value="A new generation of Google MySQL tools" -->
<!--# set var="date" value="April 1, 2011" -->
<!--# include file="include/top.html" -->
<p>When I started at Google, the MySQL team had a moderate open source presence. The largest part was the Google server patches for 4.0, 5.0 and some starter work on 5.1. There was also a small set of tools: mypgrep, mstat and some others. Chip Turner, who did the tools releases, had already moved to another team, and we haven't released new tools since.</p>
<p>I'm now happy to announce a new round of tool releases. We're just getting started, but here's what's available so far:</p>
<ul>
<li><a href="http://code.google.com/p/google-mysql-tools/source/browse/trunk/pylib/db.py">db.py</a>: Easily execute queries in parallel on a sharded database</li>
<li><a href="http://code.google.com/p/google-mysql-tools/source/browse/trunk/sql.py">sql.py</a>: Interactive shell to db.py</li>
<li><a href="http://code.google.com/p/google-mysql-tools/source/browse/trunk/permissions.py">permissions.py</a>: Manage MySQL permissions in a Python-based format</li>
<li><a href="http://code.google.com/p/google-mysql-tools/source/browse/trunk/validate.py">validate.py</a>: Parse SQL using pyparsing and apply rules with live DB data</li>
</ul>
<p>These are the actual tools being used to run MySQL at scale inside Google, not one-time sanitized copies. You can get them at <a href="http://code.google.com/p/google-mysql-tools/">http://code.google.com/p/google-mysql-tools/</a>. The old tools and patches are still available in <a href="http://code.google.com/p/google-mysql-tools/source/browse/#svn%2Ftrunk%2Fold">old/</a>.</p>
<p>Thanks to the whole team for their work on these tools and especially to Razvan Musaloiu-E. for handling release code reviews. Watch/subscribe to this blog or subscribe to <a href="http://groups.google.com/group/google-mysql-tools">the google-mysql-tools mailing list</a> for future updates. If you'll be at the <a href="http://en.oreilly.com/mysql2011/">2011 MySQL conference</a>, stop by my talk with <a href="http://en.oreilly.com/mysql2011/public/schedule/speaker/8129">Eric Rollins</a> on <a href="http://en.oreilly.com/mysql2011/public/schedule/detail/17137">automatic failover</a> and <a href="http://en.oreilly.com/mysql2011/public/schedule/speaker/57828">Mikey Dickerson</a>'s on <a href="http://en.oreilly.com/mysql2011/public/schedule/detail/17138">detecting data drift</a>.</p>
<!--# include file="include/bottom.html" -->

1
index.html
View File

@@ -20,6 +20,7 @@
<li>2016-Feb-15: <a href="2016-02-15-cable-modem-channel-party.html">Cable modem channel party</a></li> <li>2016-Feb-15: <a href="2016-02-15-cable-modem-channel-party.html">Cable modem channel party</a></li>
<li>2016-Feb-01: <a href="2016-02-01-how-to-enrage-your-cable-modem.html">How to enrage your cable modem</a></li> <li>2016-Feb-01: <a href="2016-02-01-how-to-enrage-your-cable-modem.html">How to enrage your cable modem</a></li>
<li>2016-Feb-01: <a href="2016-02-01-hall-of-2-4-ghz-shame-2016-edition.html">Hall of 2.4 GHz Shame, 2016 Edition</a></li> <li>2016-Feb-01: <a href="2016-02-01-hall-of-2-4-ghz-shame-2016-edition.html">Hall of 2.4 GHz Shame, 2016 Edition</a></li>
<li>2011-Apr-01: <a href="2011-04-01-a-new-generation-of-google-mysql-tools.html">A new generation of Google MySQL tools</a></li>
<li>2010-Aug-22: <a href="2010-08-22-net-neutrality.html">Net Neutrality?</a></li> <li>2010-Aug-22: <a href="2010-08-22-net-neutrality.html">Net Neutrality?</a></li>
<li>2010-Apr-10: <a href="2010-04-10-home-video-rethink.html">Home video re-think</a></li> <li>2010-Apr-10: <a href="2010-04-10-home-video-rethink.html">Home video re-think</a></li>
<li>2010-Apr-07: <a href="2010-04-07-wireless-network-optimization-2010-edition.html">(Wireless) network optimization, 2010 edition</a></li> <li>2010-Apr-07: <a href="2010-04-07-wireless-network-optimization-2010-edition.html">(Wireless) network optimization, 2010 edition</a></li>

19
markdown/2011-04-01-a-new-generation-of-google-mysql-tools.md Normal file
View File

@@ -0,0 +1,19 @@
<!--# set var="title" value="A new generation of Google MySQL tools" -->
<!--# set var="date" value="April 1, 2011" -->
<!--# include file="include/top.html" -->
When I started at Google, the MySQL team had a moderate open source presence. The largest part was the Google server patches for 4.0, 5.0 and some starter work on 5.1. There was also a small set of tools: mypgrep, mstat and some others. Chip Turner, who did the tools releases, had already moved to another team, and we haven't released new tools since.
I'm now happy to announce a new round of tool releases. We're just getting started, but here's what's available so far:
* [db.py](http://code.google.com/p/google-mysql-tools/source/browse/trunk/pylib/db.py): Easily execute queries in parallel on a sharded database
* [sql.py](http://code.google.com/p/google-mysql-tools/source/browse/trunk/sql.py): Interactive shell to db.py
* [permissions.py](http://code.google.com/p/google-mysql-tools/source/browse/trunk/permissions.py): Manage MySQL permissions in a Python-based format
* [validate.py](http://code.google.com/p/google-mysql-tools/source/browse/trunk/validate.py): Parse SQL using pyparsing and apply rules with live DB data
These are the actual tools being used to run MySQL at scale inside Google, not one-time sanitized copies. You can get them at [http://code.google.com/p/google-mysql-tools/](http://code.google.com/p/google-mysql-tools/). The old tools and patches are still available in [old/](http://code.google.com/p/google-mysql-tools/source/browse/#svn%2Ftrunk%2Fold).
Thanks to the whole team for their work on these tools and especially to Razvan Musaloiu-E. for handling release code reviews. Watch/subscribe to this blog or subscribe to [the google-mysql-tools mailing list](http://groups.google.com/group/google-mysql-tools) for future updates. If you'll be at the [2011 MySQL conference](http://en.oreilly.com/mysql2011/), stop by my talk with [Eric Rollins](http://en.oreilly.com/mysql2011/public/schedule/speaker/8129) on [automatic failover](http://en.oreilly.com/mysql2011/public/schedule/detail/17137) and [Mikey Dickerson](http://en.oreilly.com/mysql2011/public/schedule/speaker/57828)'s on [detecting data drift](http://en.oreilly.com/mysql2011/public/schedule/detail/17138).
<!--# include file="include/bottom.html" -->

1
markdown/index.md
View File

@@ -19,6 +19,7 @@
1. 2016-Feb-15: [Cable modem channel party](2016-02-15-cable-modem-channel-party.html) 1. 2016-Feb-15: [Cable modem channel party](2016-02-15-cable-modem-channel-party.html)
1. 2016-Feb-01: [How to enrage your cable modem](2016-02-01-how-to-enrage-your-cable-modem.html) 1. 2016-Feb-01: [How to enrage your cable modem](2016-02-01-how-to-enrage-your-cable-modem.html)
1. 2016-Feb-01: [Hall of 2.4 GHz Shame, 2016 Edition](2016-02-01-hall-of-2-4-ghz-shame-2016-edition.html) 1. 2016-Feb-01: [Hall of 2.4 GHz Shame, 2016 Edition](2016-02-01-hall-of-2-4-ghz-shame-2016-edition.html)
1. 2011-Apr-01: [A new generation of Google MySQL tools](2011-04-01-a-new-generation-of-google-mysql-tools.html)
1. 2010-Aug-22: [Net Neutrality?](2010-08-22-net-neutrality.html) 1. 2010-Aug-22: [Net Neutrality?](2010-08-22-net-neutrality.html)
1. 2010-Apr-10: [Home video re-think](2010-04-10-home-video-rethink.html) 1. 2010-Apr-10: [Home video re-think](2010-04-10-home-video-rethink.html)
1. 2010-Apr-07: [(Wireless) network optimization, 2010 edition](2010-04-07-wireless-network-optimization-2010-edition.html) 1. 2010-Apr-07: [(Wireless) network optimization, 2010 edition](2010-04-07-wireless-network-optimization-2010-edition.html)