Reply on the comments on When is Statistical Significance not Significant?

In this article we reply to Silva and Guarnieri (2014) comments on Figueiredo Filho et al (2013) paper published by the Brazilian Political Science Review. Originally, we developed four recommendations: (1) scholars must always graphically analyze their data before interpreting the p-value; (2) it is pointless to estimate the p-value for non-random samples; (3) the p-value is highly affected by the sample size and (4) it is pointless to estimate the p-value when dealing with data on population. Here we defend our view about the proper use the p-value statistic and we use both observational and simulation data to make our case. Substantively, we hope to advance the debate about statistical significance in Political Science.