Editing Twitter Analysis DB Details
Jump to navigation
Jump to search
Warning: You are not logged in. Your IP address will be publicly visible if you make any edits. If you log in or create an account, your edits will be attributed to your username, along with other benefits.
The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then save the changes below to finish undoing the edit.
Latest revision | Your text | ||
Line 10: | Line 10: | ||
* I have not tuned the db for performance. Got suggestions ( that are more than just guesses ) Let me know. I am sure that more indexing might help, will try in time. | * I have not tuned the db for performance. Got suggestions ( that are more than just guesses ) Let me know. I am sure that more indexing might help, will try in time. | ||
− | |||
− | |||
− | |||
− | |||
= Debugging = | = Debugging = | ||
Line 21: | Line 17: | ||
* tweaking the parameter file for your computer | * tweaking the parameter file for your computer | ||
* Installing missing modules / packages. | * Installing missing modules / packages. | ||
− | |||
− | |||
The program does not come with an installer You should drop the code into your Python 3.6 development environment. | The program does not come with an installer You should drop the code into your Python 3.6 development environment. | ||
see: [[Twitter Analysis DB]] Configure to Run. | see: [[Twitter Analysis DB]] Configure to Run. | ||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
= Building a Database = | = Building a Database = | ||
− | DB building facilities | + | I am working on providing DB building facilities from the GUI. Since this is sensitive to the input sources it only works with the type of input sources I have used. Not everything is in the GUI as of this writing, this will probably change. |
− | |||
− | |||
− | |||
− | |||
− | |||
== Parameters == | == Parameters == | ||
Line 119: | Line 45: | ||
== Run the GUI == | == Run the GUI == | ||
+ | |||
* <Show Load Parameters> will show you the values of some of the parameters used to load the db. If you do not like what you get edit the parameter file. ( and there is a button for that too ) | * <Show Load Parameters> will show you the values of some of the parameters used to load the db. If you do not like what you get edit the parameter file. ( and there is a button for that too ) | ||
Line 128: | Line 55: | ||
== Some Code and Theory == | == Some Code and Theory == | ||
− | |||
− | |||
− | load_tweets_data.py contains the code for defining and loading | + | load_tweets_data.py contains the code for defining and loading the db tables. define_table_tweets() and define table_concord methods ... do the defominational work.... read the code. |
A class TweetFileProcessor performs the table loads. Again read the code. The general idea is: | A class TweetFileProcessor performs the table loads. Again read the code. The general idea is: | ||
Line 154: | Line 79: | ||
I have tried to make the above accurate, but read the code. | I have tried to make the above accurate, but read the code. | ||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | + | TweetTableWriter and ConcordTableWriter are helper classes doing the actual table writing | |
− | |||
− | |||
− | |||